-- Logs begin at Tue 2022-04-26 13:18:19 UTC, end at Tue 2022-04-26 14:27:54 UTC. -- Apr 26 13:49:45.976148 dv-cinder-835133-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 26 13:49:45.984777 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 26 13:49:45 2022] *** Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: nodename: dv-cinder-835133-2-iscsi Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: machine: x86_64 Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: clock source: unix Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: pcre jit disabled Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: detected number of CPU cores: 4 Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: current working directory: / Apr 26 13:49:45.986774 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: detected binary path: /usr/bin/uwsgi-core Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: your processes number limit is 47680 Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: your memory page size is 4096 bytes Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: detected max file descriptor number: 2048 Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: lock engine: pthread robust mutexes Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: thunder lock: enabled Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 26 13:49:45.987438 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 26 13:49:46.032782 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: Python main interpreter initialized at 0x55b5425599c0 Apr 26 13:49:46.032782 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: python threads support enabled Apr 26 13:49:46.032782 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: your server socket listen backlog is limited to 100 connections Apr 26 13:49:46.032782 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: your mercy for graceful operations on workers is 90 seconds Apr 26 13:49:46.033114 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: mapped 403077 bytes (393 KB) for 2 cores Apr 26 13:49:46.033191 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: *** Operational MODE: preforking *** Apr 26 13:49:46.033460 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: *** uWSGI is running in multiple interpreter mode *** Apr 26 13:49:46.033460 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: spawned uWSGI master process (pid: 80029) Apr 26 13:49:46.033650 dv-cinder-835133-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 26 13:49:46.038646 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: spawned uWSGI worker 1 (pid: 80041, cores: 1) Apr 26 13:49:46.038646 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: spawned uWSGI worker 2 (pid: 80042, cores: 1) Apr 26 13:49:46.038646 dv-cinder-835133-2-iscsi devstack@keystone.service[80029]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 26 13:49:51.795075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 13:49:51.795075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: from cryptography.utils import int_from_bytes Apr 26 13:49:51.795799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 13:49:51.795799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: from cryptography.utils import int_from_bytes Apr 26 13:49:51.796209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 13:49:51.796209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: from cryptography.utils import int_from_bytes Apr 26 13:49:51.796316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 13:49:51.796316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: from cryptography.utils import int_from_bytes Apr 26 13:49:51.840244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 26 13:49:51.840390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 26 13:49:51.840473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 26 13:49:51.840559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 26 13:49:51.840640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] command line args: [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 26 13:49:51.840719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] command line args: [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 26 13:49:51.840869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 26 13:49:51.840949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 26 13:49:51.841053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ================================================================================ {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 26 13:49:51.841140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ================================================================================ {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 26 13:49:51.841311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] admin_token = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.841396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] admin_token = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.841557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] config_dir = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.841635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] config_dir = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.841743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.841826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.841907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] config_source = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] config_source = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] debug = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] debug = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.842961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_config_append = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_config_append = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.843978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_dir = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_dir = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_file = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_file = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.844924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.845865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.846879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.847022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.847122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.847267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.847356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.847539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.847623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] publish_errors = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] publish_errors = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.848915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] standard_threads = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] standard_threads = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.849941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] use_journal = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] use_journal = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] use_json = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] use_json = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850631 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] use_stderr = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] use_stderr = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] use_syslog = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.850890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] use_syslog = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.851037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.851119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 13:49:51.851295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.851382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.851532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.851608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.851793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.851882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.852028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.852113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.852799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.852884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.853843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.854994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855223 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855555 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.855956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.856935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.857925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858490 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.858974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.859911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.860941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.861946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.862119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.869635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.869720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.869795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.869884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.869960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.870987 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.871961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.872929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.873919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.874949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875023 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.875982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.876971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.877947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.878930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.external = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.external = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.879952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.password = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.password = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] auth.token = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] auth.token = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.880985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.881916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.882949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.883932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.884905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.885885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.886869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.887982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.888922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.889984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.890950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.891877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.892967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.893909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.894938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.895866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.896958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.897901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.898946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.899942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.900857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.901951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.902990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.903923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.904859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.905962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.906920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.907963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.908939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] role.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] role.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.909863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] role.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] role.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.910852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.911969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.912059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.912269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.912380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.912502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.912752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.913084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.913265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.913403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.913518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.913769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.913849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.914179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.914275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.914431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.914517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.915956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.916964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.917894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.918879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.919971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.920929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.921989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.922929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.connection = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.923903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.connection = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.924885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.925832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.926968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.927993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.928090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 26 13:49:51.928319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.928696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.929085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.929453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.929840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.930254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 13:49:51.931191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80042) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 26 13:49:51.958999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.959231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.959662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.961683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.961915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.962164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.968155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.970673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.997196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.997424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.997645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:51.997876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.051140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.051263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.099797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.099921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.100035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.100122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.165847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.166996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.167128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.167343 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.191952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.192711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.203854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.207219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.217162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.217396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.217623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.217848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.218092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.218309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.218528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80041) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.219411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.219642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.219864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.220081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.220292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.220502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.220712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80042) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 26 13:49:52.236416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.236629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 26 13:49:52.236968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.237170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 26 13:49:52.237439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.237699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.237958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.238243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.241608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.241916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 26 13:49:52.242427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.242719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 26 13:49:52.243137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.243508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.243883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.244260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.248911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.249192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.249461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.249741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.257916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.261205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.261487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.261771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.262976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.263162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.263245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.263429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.263701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.263965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.275465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.278763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.279156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.279559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.279965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.280373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.280744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.281123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.281512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.281907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.282355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.282742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.292361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.294000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.294276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.299602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.299882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.300162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.307491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.307728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.312162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.312450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.312734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.313016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.313290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.313565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.313834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.314127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.318796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.320397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.320671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.325959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.326262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.326653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.332583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.332861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.333851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.334154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.337906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.339119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.339412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.339687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.339977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.340254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.340525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.340788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.341187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.341602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.341897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.346884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.350466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.354628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.354923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.355209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.355487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.355760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.356052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.360281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.360554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.365038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.368676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.368968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.374047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.375001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.375294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.375571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.375834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.377604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.381208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.381502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.381784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.382092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.382378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.382670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.383635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.385445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.385721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.388749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.389030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.389311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.389611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.389897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.402044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.402331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.402594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.402852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.404803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.405089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.405382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.405668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.405956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.406259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.406537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.410609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.412304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.412575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.416584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.416863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.417139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.417435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.417712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.425014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.428256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.430897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.431178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.431456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.431740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.432018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.432388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.432663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.450718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.454039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.457351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.460434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.462625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.462902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.463180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.470532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.472158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.475443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.475742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.530950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.532579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.534256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.534542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.534837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.542556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.544200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.547695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.548001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.548285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.548557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.557878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.558141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.558443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.566489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80041) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.566780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.567063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.567340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.567612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.567899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.568179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.568456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.568733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.569003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.569280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.569542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.569808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.570105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80041) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.574252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.574586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.590126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.590535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.590932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.603840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80042) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 26 13:49:52.604509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.604950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.605389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.605822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.606298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.606753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.607211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.607659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.608090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.608527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.608610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b5425599c0 pid: 80041 (default app) Apr 26 13:49:52.608951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.609394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.609830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80042) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 26 13:49:52.611878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c44cd-ad8a-46da-b4db-9441e19fcb16 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:49:52.612173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c44cd-ad8a-46da-b4db-9441e19fcb16 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:49:52.612452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c44cd-ad8a-46da-b4db-9441e19fcb16 None None] PATH_INFO: `/v3` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:49:52.616722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Tue Apr 26 13:49:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:49:52.654878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b5425599c0 pid: 80042 (default app) Apr 26 13:50:01.654830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39be04-5d26-48d2-8835-220b8700cc04 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:01.655393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39be04-5d26-48d2-8835-220b8700cc04 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:01.655393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39be04-5d26-48d2-8835-220b8700cc04 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:01.657430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:01.665020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:01.665433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:01.665572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:01.694694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG oslo_db.sqlalchemy.engines [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80042) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 13:50:01.876466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG passlib.handlers.bcrypt [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80042) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 26 13:50:01.876886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG passlib.handlers.bcrypt [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80042) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 26 13:50:01.932871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:01.934570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:02.057534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1/3] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 26 13:50:02.196596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39be04-5d26-48d2-8835-220b8700cc04 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:02.229272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG oslo_db.sqlalchemy.engines [None req-2b39be04-5d26-48d2-8835-220b8700cc04 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 13:50:02.354565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39be04-5d26-48d2-8835-220b8700cc04 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:02.358786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:02.359438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:02.359726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:02.360005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:02.368471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:02.417788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 26 13:50:02.418157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e747df-6f27-41b0-981b-7a1cf27cf9e2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:02.427380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 3/4] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Apr 26 13:50:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 13:50:02.433950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:02.448033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e8b38-6b48-42e5-80af-076b8b6170f2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:02.452454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:02.453624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:02.453910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:02.454237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] PATH_INFO: `/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:02.455855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] RBAC: Authorizing `identity:get_project(project_id=5c5b2c20b09b4ef2a475aac6bfb52ad9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:02.507163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 26 13:50:02.507505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a60bb4-34b1-4d0d-945d-577f213e3b35 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:02.512001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 2/5] 10.222.0.23 () {56 vars in 1207 bytes} [Tue Apr 26 13:50:02 2022] GET /identity/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:04.768182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acb39-b69b-439c-80c9-bd5c9150f4ef None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:04.768659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acb39-b69b-439c-80c9-bd5c9150f4ef None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:04.768659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224acb39-b69b-439c-80c9-bd5c9150f4ef None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:04.773136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 4/6] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:04.778455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:04.778864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:04.779018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:04.798170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:04.799684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:04.808190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 3/7] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 26 13:50:04.830376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acb39-b69b-439c-80c9-bd5c9150f4ef None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:04.842651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224acb39-b69b-439c-80c9-bd5c9150f4ef None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:04.846859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be6e9-c533-4cca-b2a9-67f4a8773481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:04.847473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be6e9-c533-4cca-b2a9-67f4a8773481 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:04.847757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be6e9-c533-4cca-b2a9-67f4a8773481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:04.848035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be6e9-c533-4cca-b2a9-67f4a8773481 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:04.855567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be6e9-c533-4cca-b2a9-67f4a8773481 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:04.857317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8be6e9-c533-4cca-b2a9-67f4a8773481 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:04.865783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 5/8] 10.222.0.23 () {58 vars in 1324 bytes} [Tue Apr 26 13:50:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 13:50:04.871411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:04.880038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85e2e-c99c-46ba-906d-bcd3e03b93bc None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:04.885142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96375ccb-ce47-48cb-80bb-ed3952c78612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:04.886006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375ccb-ce47-48cb-80bb-ed3952c78612 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:04.886289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375ccb-ce47-48cb-80bb-ed3952c78612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:04.886563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96375ccb-ce47-48cb-80bb-ed3952c78612 admin admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:04.887919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96375ccb-ce47-48cb-80bb-ed3952c78612 admin admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:04.889724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96375ccb-ce47-48cb-80bb-ed3952c78612 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:04.891330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 4/9] 10.222.0.23 () {56 vars in 1198 bytes} [Tue Apr 26 13:50:04 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:07.189734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ad93-2e37-431b-aace-be2cec8993b0 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.190311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ad93-2e37-431b-aace-be2cec8993b0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.190311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98ad93-2e37-431b-aace-be2cec8993b0 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.192251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:07.197101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.197486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.197774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.214696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:07.215873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:07.218818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490633f8-5a16-496c-ba9b-40571366330e None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.219108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490633f8-5a16-496c-ba9b-40571366330e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.219383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490633f8-5a16-496c-ba9b-40571366330e None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.221094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 7/11] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:07.226195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.226483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.227342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.266824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG passlib.handlers.bcrypt [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=80041) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 26 13:50:07.267236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG passlib.handlers.bcrypt [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80041) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 26 13:50:07.292484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 5/12] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:07.314928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.315556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:07.317148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:07.412623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 8/13] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:07.413916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9f1f1-8233-45ce-b790-d9b958dbc4ca None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:07.435351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.447714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:07.448503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.448785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.449049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.459692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:07.467147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:07.468513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 6/14] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:07.474103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.532332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8344ab0-a7e4-4cbd-95d4-15fdefab8111 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:07.565465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:07.566365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.566653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.566933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.567752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4eaced-9acb-424c-9833-98bff62f03a3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:07.601731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:07.602425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.602704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.602978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.603723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:07.604027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:07.605467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:07.617815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 7/15] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:07.623424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.641529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:07.643974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:07.716543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1638423-7a05-4a6d-866c-ac8f9885da00 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:07.740611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 9/16] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:50:07.746280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.747934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:07.748804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.749088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.749366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.750610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:07.752082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:07.753682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 8/17] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:07.759342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.838752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742f40-477e-4747-b5f9-b8279fad660e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:07.851063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7acc04-ec5f-41b6-af07-3244c768bdaf None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:07.870324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:07.871104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.871392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.871668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.882750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:07.884060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:07.884343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:07.884622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:07.885799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:07.887433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:07.889026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:07.890125 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:07.891607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:07.894613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.908297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:50:07.909636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:07.915250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:07.991437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99981c17-f003-4ebb-8312-170d5e036203 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:08.011300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eefbc1-5ddf-4a8d-a38f-d54d287273be None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:08.024241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:08.024896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:08.025179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:08.025453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:08.026316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.domain.id=default, user.id=4889fd0e623346d287cebc77099e6590) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:08.026625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:08.028078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefe1ef-abd6-450b-b625-bd9e78bcb523 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:08.034486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/role_assignments?user.id=4889fd0e623346d287cebc77099e6590&scope.domain.id=default&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 233 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:08.044024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:08.044711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:08.044997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:08.045287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:08.046071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:08.046386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:08.047831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc26332-1c63-423e-ad81-f4a84ad7dbec None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:08.068889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:10.548571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88abcd-3f1a-4638-afa3-65fbe7620139 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:10.549612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88abcd-3f1a-4638-afa3-65fbe7620139 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:10.550137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88abcd-3f1a-4638-afa3-65fbe7620139 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:10.552693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:10.557799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1221f-91e1-4019-ba26-9ed3bda356f0 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:10.558671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1221f-91e1-4019-ba26-9ed3bda356f0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:10.559147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1221f-91e1-4019-ba26-9ed3bda356f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:10.582933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1af1221f-91e1-4019-ba26-9ed3bda356f0 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:10.584463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1af1221f-91e1-4019-ba26-9ed3bda356f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:10.666888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 12/23] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:10.701197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88abcd-3f1a-4638-afa3-65fbe7620139 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:10.821902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88abcd-3f1a-4638-afa3-65fbe7620139 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:10.854516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80a8ed-3e70-47e1-b14f-fba01345d83f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:10.855151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80a8ed-3e70-47e1-b14f-fba01345d83f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:10.855649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80a8ed-3e70-47e1-b14f-fba01345d83f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:10.857752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:10.863417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:10.864078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:10.864569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:10.875774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:10.876593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:10.876877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:10.877155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:10.898583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:10.905668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:10.907049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:10.907740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 12/25] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:10.908401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:10.913875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.048605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 14/26] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:11.089078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.133537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602004a4-c1c6-4a38-ad56-f7ab079578d6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.207617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.208303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.208591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.208868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.209622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:11.209928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:11.211390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:11.230102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 13/27] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:11.235956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.319964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a984-1d49-4b3e-98d1-a70df660a747 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.418715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.419531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.419821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.420102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.439788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb64aaa-973f-43f9-ae19-61bb2e6ac275 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.456070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:11.457566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:11.486081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-9cdd63c3-2b62-4e54-b917-fd0ae5684890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:50:11.487375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 15/28] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:11.488543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.489448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.489728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.491382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.491382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:11.493640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:11.495529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 14/29] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:11 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:11.496370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.498095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe875-2e3e-4c7d-a569-1b1f81c3b46a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.498383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe875-2e3e-4c7d-a569-1b1f81c3b46a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.498659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fe875-2e3e-4c7d-a569-1b1f81c3b46a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.509595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:11 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:11.510581 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe875-2e3e-4c7d-a569-1b1f81c3b46a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.658517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18acfe3-1f0f-40af-96ee-9f23d18e5ed0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.700668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.701466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.701674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.701954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.703919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:11.704234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:11.705641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4ad84-5fb5-4fb5-a7fb-d04bfa6893f3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:11.728162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046fe875-2e3e-4c7d-a569-1b1f81c3b46a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.745013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 15/31] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:11.746700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.747192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.747689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.768886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:11.770198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1b0bd-831d-4663-a7f8-ffbdce258499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.770543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:11.771461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b0bd-831d-4663-a7f8-ffbdce258499 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.771928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b0bd-831d-4663-a7f8-ffbdce258499 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.772376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1b0bd-831d-4663-a7f8-ffbdce258499 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.774605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1b0bd-831d-4663-a7f8-ffbdce258499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:11.776259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1b0bd-831d-4663-a7f8-ffbdce258499 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:11.778401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 17/32] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:11.779891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164151d-9238-4116-a14d-72b488196541 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.780373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164151d-9238-4116-a14d-72b488196541 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.780822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164151d-9238-4116-a14d-72b488196541 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.782946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 18/33] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:11.783807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164151d-9238-4116-a14d-72b488196541 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.860975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 16/34] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:11.864484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:11.907754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164151d-9238-4116-a14d-72b488196541 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.941338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6103c8a-bafe-4530-9fc5-66debdbb7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.941926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103c8a-bafe-4530-9fc5-66debdbb7328 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.942348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103c8a-bafe-4530-9fc5-66debdbb7328 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.942680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103c8a-bafe-4530-9fc5-66debdbb7328 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:11.943400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6103c8a-bafe-4530-9fc5-66debdbb7328 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:11.944856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6103c8a-bafe-4530-9fc5-66debdbb7328 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:11.965321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf89f7-8e1f-4691-b4ee-3940eb921f95 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:11.998147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a47e67-105d-4c9e-88f3-cc9c03eaa816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:11.999020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47e67-105d-4c9e-88f3-cc9c03eaa816 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:11.999304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47e67-105d-4c9e-88f3-cc9c03eaa816 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:11.999588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a47e67-105d-4c9e-88f3-cc9c03eaa816 None admin] PATH_INFO: `/v3/domains/default/users/4889fd0e623346d287cebc77099e6590/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.001719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47e67-105d-4c9e-88f3-cc9c03eaa816 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4889fd0e623346d287cebc77099e6590, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:12.003220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a47e67-105d-4c9e-88f3-cc9c03eaa816 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:12.190005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 19/35] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:50:11 2022] POST /identity/v3/projects => generated 301 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:12.190005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b6978-7014-4f8a-8739-07a565eb00c6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.190005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b6978-7014-4f8a-8739-07a565eb00c6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.190005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b6978-7014-4f8a-8739-07a565eb00c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.209010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 17/36] 10.222.0.23 () {58 vars in 1361 bytes} [Tue Apr 26 13:50:11 2022] PUT /identity/v3/domains/default/users/4889fd0e623346d287cebc77099e6590/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:12.209342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b53b6978-7014-4f8a-8739-07a565eb00c6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:12.211457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b476f7c-b0aa-49d1-aa10-befca9e8b072 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.211660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b53b6978-7014-4f8a-8739-07a565eb00c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:12.211760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b476f7c-b0aa-49d1-aa10-befca9e8b072 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.212024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b476f7c-b0aa-49d1-aa10-befca9e8b072 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.227487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 18/37] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:12 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:12.228532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b476f7c-b0aa-49d1-aa10-befca9e8b072 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:12.368193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 20/38] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:12.369585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.369881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.370191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.413495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:12.415109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:12.464196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b476f7c-b0aa-49d1-aa10-befca9e8b072 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:12.510451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005c1a3-7e16-4398-812c-961fdf17486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:12.511238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 21/39] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:12.511366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c1a3-7e16-4398-812c-961fdf17486d None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.511535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c1a3-7e16-4398-812c-961fdf17486d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.511777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005c1a3-7e16-4398-812c-961fdf17486d None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.511973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:12.512595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005c1a3-7e16-4398-812c-961fdf17486d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:12.514212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005c1a3-7e16-4398-812c-961fdf17486d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:12.597180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 19/40] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 26 13:50:12 2022] POST /identity/v3/roles => generated 219 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:12.602013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daebb8e-3a71-4450-ac88-6a3353488daf None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.602013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daebb8e-3a71-4450-ac88-6a3353488daf None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.602013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daebb8e-3a71-4450-ac88-6a3353488daf None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.602013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 20/41] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:12.602377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daebb8e-3a71-4450-ac88-6a3353488daf None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:12.612795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751f8f1-7428-488f-b7da-242b6cf9cd72 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:12.650991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade4ece-d6f5-4c91-95fe-82aa149148c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:12.651671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4ece-d6f5-4c91-95fe-82aa149148c5 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.651957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4ece-d6f5-4c91-95fe-82aa149148c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.652238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade4ece-d6f5-4c91-95fe-82aa149148c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.652997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade4ece-d6f5-4c91-95fe-82aa149148c5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:12.654574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade4ece-d6f5-4c91-95fe-82aa149148c5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:12.714677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daebb8e-3a71-4450-ac88-6a3353488daf None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:12.725153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 26 13:50:12 2022] POST /identity/v3/roles => generated 225 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:12.736136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.737107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.737649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.753739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:12.758187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:12.758187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:12.758187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:12.758187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:12.758187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:12.768208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:12.770274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:12.831561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 21/43] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 26 13:50:12 2022] POST /identity/v3/roles => generated 223 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:12.856721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 23/44] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:12.885782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:13.014484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91af64-a7cc-4929-b46e-cdb6489cf4e5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:13.054713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e697cd8-62dd-430c-92c2-e60530f6dda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:13.055523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e697cd8-62dd-430c-92c2-e60530f6dda2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:13.055810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e697cd8-62dd-430c-92c2-e60530f6dda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:13.056087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e697cd8-62dd-430c-92c2-e60530f6dda2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:13.057385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e697cd8-62dd-430c-92c2-e60530f6dda2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:13.058964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e697cd8-62dd-430c-92c2-e60530f6dda2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:13.060817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 22/45] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:13.066248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:13.170671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f19a-f7cd-4e5a-b24e-aa358dd8ca8a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:13.203240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36b91d-96a2-4417-beeb-e120a6746df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:13.203903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36b91d-96a2-4417-beeb-e120a6746df1 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:13.204192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36b91d-96a2-4417-beeb-e120a6746df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:13.204474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36b91d-96a2-4417-beeb-e120a6746df1 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:13.205188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36b91d-96a2-4417-beeb-e120a6746df1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:13.206670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e36b91d-96a2-4417-beeb-e120a6746df1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:13.284599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:50:13 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:14.633412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb32962-2ac9-4f6f-b813-dee00b2ee8bd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:14.633936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb32962-2ac9-4f6f-b813-dee00b2ee8bd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:14.633936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb32962-2ac9-4f6f-b813-dee00b2ee8bd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:14.635762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:14.641041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:14.641432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:14.641674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:14.658576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:14.659759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:14.723347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:14.746506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb32962-2ac9-4f6f-b813-dee00b2ee8bd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:14.841596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb32962-2ac9-4f6f-b813-dee00b2ee8bd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:14.872666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:14.873448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:14.873727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:14.874021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:14.883886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:14.890701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:14.891875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:14.897593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:14.991604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21499ecc-1713-4529-abca-36ef607ac805 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:15.024113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:15.024776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.025068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.025349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.026139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:15.026453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:15.027854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:15.039746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 26/50] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:15.044978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:15.139614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b68b3-acc2-49b0-8e58-720ab4a4c649 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:15.171258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:15.172131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.172417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.172692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.173885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:15.175378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:15.177006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 25/51] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:15 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:15.182468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:15.282066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ac4bb-4c88-4391-86e2-2bc056454f53 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:15.313820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13499d-f463-451d-8e48-a8a4377f0bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:15.314634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13499d-f463-451d-8e48-a8a4377f0bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.314926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13499d-f463-451d-8e48-a8a4377f0bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.315203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13499d-f463-451d-8e48-a8a4377f0bc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.316388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13499d-f463-451d-8e48-a8a4377f0bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:15.317852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13499d-f463-451d-8e48-a8a4377f0bc0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:15.319699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:15.325638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:15.422108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a38919-4f93-402f-9ec5-d67a777987ef None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:15.455307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:15.455970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.456258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.456540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.457374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.domain.id=default, user.id=4889fd0e623346d287cebc77099e6590) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:15.457690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:15.459169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701e598-7cff-4c25-8b57-f9c6197d2277 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:15.465265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1322 bytes} [Tue Apr 26 13:50:15 2022] GET /identity/v3/role_assignments?user.id=4889fd0e623346d287cebc77099e6590&scope.domain.id=default&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:15.562257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37217e-978f-4773-97aa-603ea98acdb5 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.562498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37217e-978f-4773-97aa-603ea98acdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.562786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37217e-978f-4773-97aa-603ea98acdb5 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.564599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 28/54] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:15.570751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.571043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.571321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.589238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:15.590863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:15.658647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 27/55] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:15.682609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37217e-978f-4773-97aa-603ea98acdb5 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:15.779711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37217e-978f-4773-97aa-603ea98acdb5 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:15.810819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94ca7c-823e-4fde-b938-938cd974b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:15.811599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94ca7c-823e-4fde-b938-938cd974b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.811888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94ca7c-823e-4fde-b938-938cd974b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.812167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94ca7c-823e-4fde-b938-938cd974b5b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.813378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94ca7c-823e-4fde-b938-938cd974b5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:15.814791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94ca7c-823e-4fde-b938-938cd974b5b1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:15.816387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:15.822469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:15.912582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cae90-4339-4ee8-b9e8-045ff6d91768 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:15.943437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6824e99-4d24-4d50-b10f-2df8edb87fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:15.944084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6824e99-4d24-4d50-b10f-2df8edb87fcd None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:15.944370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6824e99-4d24-4d50-b10f-2df8edb87fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:15.944645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6824e99-4d24-4d50-b10f-2df8edb87fcd None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:15.945872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6824e99-4d24-4d50-b10f-2df8edb87fcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:15.947346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6824e99-4d24-4d50-b10f-2df8edb87fcd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:16.036936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Apr 26 13:50:15 2022] POST /identity/v3/projects => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:18.300679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5c004-ab76-4826-a49b-02bdc421b72e None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:18.301198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5c004-ab76-4826-a49b-02bdc421b72e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:18.301280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5c004-ab76-4826-a49b-02bdc421b72e None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:18.303101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:18.308890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:18.309304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:18.309452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:18.325809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:18.327040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:18.388874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:18.413630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5c004-ab76-4826-a49b-02bdc421b72e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:18.509888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5c004-ab76-4826-a49b-02bdc421b72e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:18.542161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89e33-0c2b-4c94-b5c2-6a0908a12eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:18.542937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89e33-0c2b-4c94-b5c2-6a0908a12eba None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:18.543224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89e33-0c2b-4c94-b5c2-6a0908a12eba None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:18.543504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89e33-0c2b-4c94-b5c2-6a0908a12eba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:18.544671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb89e33-0c2b-4c94-b5c2-6a0908a12eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:18.546135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb89e33-0c2b-4c94-b5c2-6a0908a12eba None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:18.547721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:18.553166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:18.644316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a84dd-e9e7-477c-a698-c6679cbf5eed None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:18.676815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b2730-9887-4044-953c-a7b81b269f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:18.677470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2730-9887-4044-953c-a7b81b269f93 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:18.677754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2730-9887-4044-953c-a7b81b269f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:18.683720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b2730-9887-4044-953c-a7b81b269f93 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:18.683720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2730-9887-4044-953c-a7b81b269f93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:18.683720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b2730-9887-4044-953c-a7b81b269f93 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:18.780414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:18 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:22.127477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603a23-d987-48d4-8e9f-c091297dc346 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.127983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603a23-d987-48d4-8e9f-c091297dc346 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.128057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2603a23-d987-48d4-8e9f-c091297dc346 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.129808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:22.147642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e96f-3cef-4a1e-a2fe-e9b51f49c1d2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.149091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e96f-3cef-4a1e-a2fe-e9b51f49c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.149552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560e96f-3cef-4a1e-a2fe-e9b51f49c1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.178627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b560e96f-3cef-4a1e-a2fe-e9b51f49c1d2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:22.180287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b560e96f-3cef-4a1e-a2fe-e9b51f49c1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:22.267735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:22.315522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2603a23-d987-48d4-8e9f-c091297dc346 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:22.377743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b114f9-1028-41e3-94cd-839e11b646fa None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.378372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b114f9-1028-41e3-94cd-839e11b646fa None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.378885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b114f9-1028-41e3-94cd-839e11b646fa None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.380885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 32/64] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:22.385960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.386511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.386985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.423249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:22.424510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:22.454767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2603a23-d987-48d4-8e9f-c091297dc346 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:22.506694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:22.508059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.508349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.508632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.518909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 33/65] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:22.522522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:22.529989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:22.531492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 33/66] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:22.536870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:22.548807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:22.668273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944532ea-dd2c-47c9-aec2-9e289e4fe4e1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:22.699567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6771a-8365-42d0-b207-5b6c7205faf7 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:22.702829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2209d2-955e-49ba-b5e6-9874f4e8be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:22.703912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2209d2-955e-49ba-b5e6-9874f4e8be35 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.704383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2209d2-955e-49ba-b5e6-9874f4e8be35 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.704848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2209d2-955e-49ba-b5e6-9874f4e8be35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.716399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2209d2-955e-49ba-b5e6-9874f4e8be35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:22.723312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-dd2209d2-955e-49ba-b5e6-9874f4e8be35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:22.724519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 34/67] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:22.725823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2060-04f2-424d-a2b4-9d64538bb21a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.726166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2060-04f2-424d-a2b4-9d64538bb21a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.726636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec2060-04f2-424d-a2b4-9d64538bb21a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.728964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 35/68] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:22.730520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaea3-2df4-4d0f-8486-fa845a059da1 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.731030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaea3-2df4-4d0f-8486-fa845a059da1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.731508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebaea3-2df4-4d0f-8486-fa845a059da1 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.737242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 36/69] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:22.737242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaea3-2df4-4d0f-8486-fa845a059da1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:22.740962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:22.741671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.741988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.742282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.743044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:22.743353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:22.744760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0afafb3-f62f-4767-be00-cc65369c33ed None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:22.753512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 34/70] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:22.754881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43530b-ba0e-4265-8e2c-11e8a59e95ff None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.755180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43530b-ba0e-4265-8e2c-11e8a59e95ff None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.755465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43530b-ba0e-4265-8e2c-11e8a59e95ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.772364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-af43530b-ba0e-4265-8e2c-11e8a59e95ff None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:22.774200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-af43530b-ba0e-4265-8e2c-11e8a59e95ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:22.838680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 35/71] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:22.839957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193f2c-515c-477f-b8be-61dfae72fa98 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.840254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193f2c-515c-477f-b8be-61dfae72fa98 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.840541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193f2c-515c-477f-b8be-61dfae72fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.843996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebaea3-2df4-4d0f-8486-fa845a059da1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:22.857305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1a193f2c-515c-477f-b8be-61dfae72fa98 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:22.858523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1a193f2c-515c-477f-b8be-61dfae72fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:22.877463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:22.878158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.878445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.878723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.879468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:22.879778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:22.881157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:22.893646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:22.893646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:22.922882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 36/73] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:22.925063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c824-b042-47e2-9997-bb9ef7844bdc None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:22.925362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c824-b042-47e2-9997-bb9ef7844bdc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:22.925644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5c824-b042-47e2-9997-bb9ef7844bdc None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:22.927553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 37/74] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:22.928122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5c824-b042-47e2-9997-bb9ef7844bdc None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:22.985352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850df5db-daf6-40c0-b7ef-59a606cb17e0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.017494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.018489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.018809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.019074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.025637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5c824-b042-47e2-9997-bb9ef7844bdc None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.033452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.034932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.036799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:22 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.037414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.058097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84511a7d-38ef-46bf-a616-9ba0339c1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.058903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511a7d-38ef-46bf-a616-9ba0339c1470 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.059183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511a7d-38ef-46bf-a616-9ba0339c1470 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.059454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84511a7d-38ef-46bf-a616-9ba0339c1470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.069032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84511a7d-38ef-46bf-a616-9ba0339c1470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:23.076818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-84511a7d-38ef-46bf-a616-9ba0339c1470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:23.078019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 38/76] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:23.079209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.079496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.079779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.096067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:23.097257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:23.131606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b0732-fc95-49b9-b9cc-2cee7902928f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.158744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 39/77] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:23.160449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.163744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.164606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.164895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.165174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.166392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.167843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.169723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 39/78] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.170519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.256207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0176f5e-58b1-406a-99f4-c795568316d9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.263495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32728-0651-4ca4-8c20-9b6cea92e62c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.286715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.287499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.287785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.288311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.294919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.295549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.295838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.296117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.298351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:23.305772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:23.306968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 40/79] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:23.308727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.359121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.360583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.400239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132857b-57da-4cd9-8488-17052c487a74 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.432435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.433109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.433397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.433675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.434457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:23.434766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.436296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.445765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.446690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.461148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 40/81] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:23.462046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.539605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e95cdb-413e-47d5-805a-c7ca747629bb None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.555852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83e0f-9a12-4ce7-9620-7d69c17b78e5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.570460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.571103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.571384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.571657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.586939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.587717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.588002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.588278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.589444 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.590939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.592536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 41/82] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.593301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.638393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.639880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.686487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd3b3c-64b7-4292-857d-6bd135623657 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.718307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.718966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.719258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.719544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.720293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:23.720604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.721958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.730198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 42/83] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.731063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.737429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 42/84] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:23.737429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.825117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a46c5-1c5e-4cc9-8db4-c539badf59a2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.828218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949498f2-a41d-48b7-bbb1-2fab83792c39 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.857642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.858522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.858808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.859083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.860223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.860340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.861084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.861375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.861656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.861739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.862906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.863468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 43/85] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.864162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.864341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.870304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 43/86] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.870304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:23.957874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad3db4-30b8-4c42-bbae-0c94bda8094c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.959321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd43482-03ed-4c14-8524-bf3dec99b9e7 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:23.989736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.990433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.990713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.990985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.991371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:23.991676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.992254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:23.992541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:23.992821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:23.993096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.994060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:23.995482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:23.997100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 44/87] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:23.997860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.072264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 44/88] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:23 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:24.073097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.095395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e9d82-30c1-4e7f-a6e0-a1c9426e3767 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.130919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.131801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.132850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.133020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.134375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.135898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.142851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 45/89] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:23 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:24.142851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.178541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ae3fd-6979-4e4c-8e07-b01fa9dfdac8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.212704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.213385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.213670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.213948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.214818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=2ea08e8a2d62450da554d5efd8fe752c) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:24.215135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.216609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.234000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 45/90] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/role_assignments?user.id=2ea08e8a2d62450da554d5efd8fe752c&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=70a105678f91431a9d75cf7309d9a810 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:24.234000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.249198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35122ee-4172-4dad-9d82-cef90f7bf664 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.287152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.288491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.289007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.289483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.371297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.372750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.391876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ca909-1d09-4a1c-8384-4da5e5fa0adb None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.437478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.438528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.439013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.439482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.493415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 46/91] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:24.494407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.523037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.524855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.613868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d9432-b3b7-4e2a-ae91-3c93d6cec5ae None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.649662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 46/92] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:24.650564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.651074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.651948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.652447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.652938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.654026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=4889fd0e623346d287cebc77099e6590) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:24.654546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.656204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.665645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 47/93] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/role_assignments?user.id=4889fd0e623346d287cebc77099e6590&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:24.666799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.812338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a9ec4-6c47-4371-88ba-0cb25219a046 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.849992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408e778-07cf-443c-9c82-447b4e225593 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:24.894737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.895615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.895906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.896184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] PATH_INFO: `/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.896984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:24.897425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] RBAC: Authorizing `identity:get_project(project_id=69d8d0d05dfd4ea4adf5c06531baf039)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.897911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:24.898227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:24.898509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:24.898976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.899804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:24.901090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 48/94] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:24.901245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:24.907260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:24.909699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 47/95] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:24.916563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:25.066106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7cab7c-c604-4268-9ee4-b654145db008 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:25.095070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f7582-e2d2-495d-90e4-689b4197440c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:25.121106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:25.121777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:25.122093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:25.122377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:25.123208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] RBAC: Adding query filter params (role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=2ea08e8a2d62450da554d5efd8fe752c) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:25.123528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:25.124998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8ea1d-a4e7-4a05-b007-5cb832c2bfc1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:25.146000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/role_assignments?user.id=2ea08e8a2d62450da554d5efd8fe752c&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=2481fa0f9e714a879311d70b522a9956 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:25.149937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:25.151293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:25.151781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:25.152261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:25.153310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=69d8d0d05dfd4ea4adf5c06531baf039, user.id=2ea08e8a2d62450da554d5efd8fe752c) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:25.153845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:25.155597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b86580-cd5f-4890-b976-4c1ff0d7527f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:25.172194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:24 2022] GET /identity/v3/role_assignments?user.id=2ea08e8a2d62450da554d5efd8fe752c&scope.project.id=69d8d0d05dfd4ea4adf5c06531baf039&role.id=70a105678f91431a9d75cf7309d9a810 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:27.046170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b50b-2220-445f-b1ee-e4defc40a10b None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.046749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b50b-2220-445f-b1ee-e4defc40a10b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.046749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371b50b-2220-445f-b1ee-e4defc40a10b None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.048525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 49/98] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:27.054295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.055203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.055644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.080728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:27.082406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:27.094260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc277d-04a3-446c-a2ea-bd0b291dc7a2 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.094555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc277d-04a3-446c-a2ea-bd0b291dc7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.094840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc277d-04a3-446c-a2ea-bd0b291dc7a2 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.096636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 50/99] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:27.105097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.105097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.105097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.133998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:27.133998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:27.179650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 50/100] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:27.218921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.236621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 51/101] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:27.279462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.357658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd0e5-786e-44c8-bc4a-4979d2481a02 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:27.411818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:27.413134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.413621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.414078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.428847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11afb0-625f-425a-9a47-9a6194673c9a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:27.431980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:27.449563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:27.451508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:27.458977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.499272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:27.500354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.500795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.501239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.523139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:27.538867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:27.540295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 52/103] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:27.546074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.593550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df273d1-b3f0-45f1-b7ed-f6331313ced1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:27.627765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:27.628665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.629102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.629537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.630488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:27.630958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:27.633083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:27.641540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 52/104] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:27.647525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.769426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2d427-fab3-4403-b694-a27dc03f707f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:27.782419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4b18a-c55e-4cdf-9f4b-f57eef62c27e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:27.814163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:27.815316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.815614 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.815901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] PATH_INFO: `/v3/users/619e869a8cce41b99660f0a2fee25428` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.816780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:27.817610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.818093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.818603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.819625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:27.820132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:27.821708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e370065-fab2-4a88-87cc-630ad7213f1c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:27.830220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 53/105] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:27.831069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] RBAC: Authorizing `identity:get_user(user_id=619e869a8cce41b99660f0a2fee25428)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:27.831992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15da08-9145-4e89-8194-5d77efbb63c0 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:27.832486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15da08-9145-4e89-8194-5d77efbb63c0 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:27.832655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:27.833123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15da08-9145-4e89-8194-5d77efbb63c0 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:27.834370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 53/106] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/users/619e869a8cce41b99660f0a2fee25428 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:27.835290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 54/107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:27.838003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.840400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15da08-9145-4e89-8194-5d77efbb63c0 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:27.951002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5559e-50c9-497f-bd9e-c72aa2bc3f10 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.014779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a326db7-28ce-4cd1-b887-c6b5eabbe9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.016025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a326db7-28ce-4cd1-b887-c6b5eabbe9ac None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.016509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a326db7-28ce-4cd1-b887-c6b5eabbe9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.016980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a326db7-28ce-4cd1-b887-c6b5eabbe9ac None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.019313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a326db7-28ce-4cd1-b887-c6b5eabbe9ac None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.020979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a326db7-28ce-4cd1-b887-c6b5eabbe9ac None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.023066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 54/108] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:28.026358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.027582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.028699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.047110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15da08-9145-4e89-8194-5d77efbb63c0 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.061705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:28.064713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:28.093549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.094602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.095465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.096275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.183612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.185122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.208392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 55/109] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:28.209203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:28.300361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 55/110] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:28.301467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:28.378616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9785944-0635-41d3-bbc5-9efec7d48664 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.429751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.430780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.431073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.431358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.432649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.434155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.435893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 56/111] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:28 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:28.441562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:28.463126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6645a-229b-4689-8990-3a901dab1a25 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.497289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e2aa6-1b3c-4eb6-a2b6-0604cd9e3223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.498545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2aa6-1b3c-4eb6-a2b6-0604cd9e3223 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.498838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2aa6-1b3c-4eb6-a2b6-0604cd9e3223 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.499115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e2aa6-1b3c-4eb6-a2b6-0604cd9e3223 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.500773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e2aa6-1b3c-4eb6-a2b6-0604cd9e3223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.502897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e2aa6-1b3c-4eb6-a2b6-0604cd9e3223 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.505166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 56/112] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:28.506741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809df2b6-2300-46b5-8124-3b06db8206fb None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.507580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809df2b6-2300-46b5-8124-3b06db8206fb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.508209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809df2b6-2300-46b5-8124-3b06db8206fb None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.510216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 57/113] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:28.511183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809df2b6-2300-46b5-8124-3b06db8206fb None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:28.553704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61caf1-09d0-44c9-bd93-8a81e47d5c86 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.589097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.589962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.590334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.590617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.591827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.593330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.595154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 57/114] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:28 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:28.595991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:28.633707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809df2b6-2300-46b5-8124-3b06db8206fb None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.676550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e0174-6c5b-4c6e-a6fc-14a4ac7ea09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.677448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0174-6c5b-4c6e-a6fc-14a4ac7ea09f None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.677900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0174-6c5b-4c6e-a6fc-14a4ac7ea09f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.678215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e0174-6c5b-4c6e-a6fc-14a4ac7ea09f None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66/users/2ea08e8a2d62450da554d5efd8fe752c/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.681067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0174-6c5b-4c6e-a6fc-14a4ac7ea09f None admin] RBAC: Authorizing `identity:create_grant(project_id=21fde128a0994d3398e451700d576d66, user_id=2ea08e8a2d62450da554d5efd8fe752c, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.682881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e0174-6c5b-4c6e-a6fc-14a4ac7ea09f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.697487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbea770-b5aa-4187-8a9e-33a58b34bfdd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:28.730545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:28.731140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.731433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.731719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.732436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:28.733877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:28.763843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 58/115] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:28 2022] PUT /identity/v3/projects/21fde128a0994d3398e451700d576d66/users/2ea08e8a2d62450da554d5efd8fe752c/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:28.765062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7a48-a953-429e-ad71-b2fc748f63b8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.765347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7a48-a953-429e-ad71-b2fc748f63b8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.765623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7a48-a953-429e-ad71-b2fc748f63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.783722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-47ce7a48-a953-429e-ad71-b2fc748f63b8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:28.784942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-47ce7a48-a953-429e-ad71-b2fc748f63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:28.829178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 58/116] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:50:28 2022] POST /identity/v3/projects => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:28.830164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:28.863247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:28.865304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ad9b-081d-4c94-b534-464340174619 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.865595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ad9b-081d-4c94-b534-464340174619 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.865873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86ad9b-081d-4c94-b534-464340174619 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.873455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 60/118] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:28.873455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf79e2c-bea7-4ea2-940a-88433b06bd64 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.873455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf79e2c-bea7-4ea2-940a-88433b06bd64 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.873455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf79e2c-bea7-4ea2-940a-88433b06bd64 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.873866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 61/119] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:28.880107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89515d6-8631-496b-a092-ba5baf012a5a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.880414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89515d6-8631-496b-a092-ba5baf012a5a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.880665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89515d6-8631-496b-a092-ba5baf012a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.903184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a89515d6-8631-496b-a092-ba5baf012a5a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:28.904795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a89515d6-8631-496b-a092-ba5baf012a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:28.982767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 62/120] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:28.984112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:28.984412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:28.984703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:28.997684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205c9d6-6507-44d4-b747-a9aaf803cc51 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.004578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:29.005792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:29.048929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.049608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.049903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.050238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.051091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] RBAC: Adding query filter params (role.id=a904b4947b61407fbf6a8e83305b09d6, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=619e869a8cce41b99660f0a2fee25428) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:29.051409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:29.052879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:29.059378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 59/121] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:28 2022] GET /identity/v3/role_assignments?user.id=619e869a8cce41b99660f0a2fee25428&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=a904b4947b61407fbf6a8e83305b09d6 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:29.059963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.087895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 63/122] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:29.088770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.187143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bf20d-1634-468c-8346-6cf316aa1453 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.195783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc782f0-756a-40c1-a0dc-27fe43c51575 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.240688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.241984 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.242543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.242828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.243103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.244334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.244620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.244897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.261220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:29.270029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:29.271784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 64/123] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:29.272381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:29.273755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.280839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:29.282369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 60/124] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:29.283173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.384806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055fe2c6-8220-44c8-b505-dca45235a837 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.407655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61be4e-9652-4d72-811d-69c6c9eca0d1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.430057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.430911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.431192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.431469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.460799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:29.467756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:29.469190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 65/125] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:29.469750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.474333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.475016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.475302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.475584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.476377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:29.476686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:29.478105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:29.492947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 61/126] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:29.493797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.598666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9b06d-f3b8-4901-89c8-331eb50ea30d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.635184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.635866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.636151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.636429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.637182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] RBAC: Adding query filter params (name=member) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:29.637492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:29.638901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:29.648674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 62/127] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:29.649751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.691996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145589e-bf09-4ece-aaf6-782d3051448b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.739739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.740816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.741884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.742389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.743401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:29.743908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:29.745501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:29.754214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 66/128] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:29.755417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.791949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac219e54-3a18-42de-93e3-bb95ede0baff None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.855438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.856316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.856612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.856893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.858704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:29.860173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:29.862051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 63/129] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:29.862608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:29.924367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58885c-19b9-4c44-93c9-5190d3ddf2b6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.965360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:29.966620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:29.967116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:29.967599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:29.968989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:29.970662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:29.972476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 67/130] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:29.982207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99315a57-61ef-4f18-a489-f3fca821c7ef None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:29.983314 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:30.018615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.020162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.020453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.020740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.022319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.027583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.031222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 64/131] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:30.039728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:30.165408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17f117-ecc3-485f-897f-bac6148278ef None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:30.192674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae1ea-d0eb-43cc-851d-d1383365ee70 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:30.229637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.230533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.230824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.231108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] PATH_INFO: `/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.232716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] RBAC: Authorizing `identity:get_project(project_id=69d8d0d05dfd4ea4adf5c06531baf039)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.234186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.235890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 65/132] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:30 2022] GET /identity/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:30.236657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:30.240283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.241154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.242027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.242380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.243708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.245154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.256480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 68/133] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:29 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:30.257496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:30.429802 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a78337-43ef-42bd-a6fd-8058ddca4361 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:30.432136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce626fe0-3bad-4b58-9619-dc49b7a8f15d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:30.467667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.468917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.469522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.469943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] PATH_INFO: `/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039/users/2ea08e8a2d62450da554d5efd8fe752c/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.472489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=69d8d0d05dfd4ea4adf5c06531baf039, user_id=2ea08e8a2d62450da554d5efd8fe752c, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.474151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.495293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.496367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.496797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.498063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.498815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.500484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.502469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 66/134] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:30 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:30.503473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:30.581858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 69/135] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:30 2022] PUT /identity/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039/users/2ea08e8a2d62450da554d5efd8fe752c/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:30.582906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:30.630124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa1974-c66c-445f-be73-bd4de5b7eb26 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:30.668035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99a328-38b2-416b-b5df-8e9c27f55b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.669188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99a328-38b2-416b-b5df-8e9c27f55b84 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.669669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99a328-38b2-416b-b5df-8e9c27f55b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.670122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99a328-38b2-416b-b5df-8e9c27f55b84 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66/users/2ea08e8a2d62450da554d5efd8fe752c/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.672671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99a328-38b2-416b-b5df-8e9c27f55b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fde128a0994d3398e451700d576d66, user_id=2ea08e8a2d62450da554d5efd8fe752c, role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.674363 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99a328-38b2-416b-b5df-8e9c27f55b84 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.779420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:30 2022] PUT /identity/v3/projects/21fde128a0994d3398e451700d576d66/users/2ea08e8a2d62450da554d5efd8fe752c/roles/2481fa0f9e714a879311d70b522a9956 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:30.791426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e140e-b7b5-491b-93eb-0ca32045a4c3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:30.838438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec424-b125-474b-8810-83d92dd93682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:30.839355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec424-b125-474b-8810-83d92dd93682 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:30.839633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec424-b125-474b-8810-83d92dd93682 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:30.839905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec424-b125-474b-8810-83d92dd93682 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66/users/4889fd0e623346d287cebc77099e6590/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:30.841954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadec424-b125-474b-8810-83d92dd93682 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fde128a0994d3398e451700d576d66, user_id=4889fd0e623346d287cebc77099e6590, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:30.843454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadec424-b125-474b-8810-83d92dd93682 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:30.918127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:30 2022] PUT /identity/v3/projects/21fde128a0994d3398e451700d576d66/users/4889fd0e623346d287cebc77099e6590/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:31.551514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c583bf-836f-459c-9970-c2c9ccca8e08 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:31.552551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c583bf-836f-459c-9970-c2c9ccca8e08 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:31.553040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c583bf-836f-459c-9970-c2c9ccca8e08 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:31.555692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 68/138] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:31.561142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579213e-f154-47f1-9336-517041bcef78 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:31.561994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579213e-f154-47f1-9336-517041bcef78 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:31.562491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579213e-f154-47f1-9336-517041bcef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:31.583374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0579213e-f154-47f1-9336-517041bcef78 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:31.585076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0579213e-f154-47f1-9336-517041bcef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:31.615203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5227-f411-491f-a64a-ec7ee745ea71 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:31.615812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5227-f411-491f-a64a-ec7ee745ea71 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:31.616880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba5227-f411-491f-a64a-ec7ee745ea71 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:31.618888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 69/139] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:31.648050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:31.648678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:31.649156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:31.677025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:31.682186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:31.686601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 71/140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:31.730667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579213e-f154-47f1-9336-517041bcef78 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:31.796456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 70/141] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:31.876918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579213e-f154-47f1-9336-517041bcef78 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:31.887056 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:31.921523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:31.922706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:31.923214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:31.923718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:31.941622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:31.949272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:31.950763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 72/142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:31.957761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:32.091992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67d9f-e185-4bbd-9f6b-b1ea2e9f2084 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:32.133133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:32.134205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.134701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.135214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.136166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:32.136675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:32.138369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:32.141689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8db17-6eac-42a0-8246-e09bf40345db None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:32.155054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 73/143] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:32.163873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:32.226929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:32.227741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.228032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.228309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.234719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:32.236220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:32.237883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 71/144] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:32.243483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:32.280752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa02726-5b3c-42aa-aada-14011b2826f1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:32.320938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64a15d-f48d-4a9d-9790-71ceaceb55c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:32.322242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a15d-f48d-4a9d-9790-71ceaceb55c9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.322746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a15d-f48d-4a9d-9790-71ceaceb55c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.323250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64a15d-f48d-4a9d-9790-71ceaceb55c9 None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.324695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64a15d-f48d-4a9d-9790-71ceaceb55c9 None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:32.326409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64a15d-f48d-4a9d-9790-71ceaceb55c9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:32.328400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 74/145] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:32 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:32.329814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff1f1-3091-4b82-abe2-9d3cdde98c32 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.330321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff1f1-3091-4b82-abe2-9d3cdde98c32 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.330794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ff1f1-3091-4b82-abe2-9d3cdde98c32 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.332654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 75/146] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:32.338213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff1f1-3091-4b82-abe2-9d3cdde98c32 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:32.440064 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bb334-b02b-45d8-850f-816798261e4b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:32.472235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ff1f1-3091-4b82-abe2-9d3cdde98c32 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:32.516954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ec02-f623-4f54-9d69-e4154fae00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:32.517744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ec02-f623-4f54-9d69-e4154fae00aa None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.518084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ec02-f623-4f54-9d69-e4154fae00aa None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.518356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ec02-f623-4f54-9d69-e4154fae00aa None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.519118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ec02-f623-4f54-9d69-e4154fae00aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:32.520626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ec02-f623-4f54-9d69-e4154fae00aa None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:32.544401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:32.546059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.546879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.547551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.624354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:32.625944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:32.655448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 72/147] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:32 2022] POST /identity/v3/users => generated 283 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:50:32.656568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.656864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.657147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.698195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:32.699356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:32.761158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 76/148] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:50:32.766826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:32.876424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 73/149] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:32.923033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb777-73d4-426b-9739-b4c17a4b9730 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:32.934221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:32.959236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:32.960848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:32.961140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:32.961417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:32.963703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:32.965822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:32.968061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 77/150] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:32 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:32.974195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:33.114920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f3da8-9b8d-43b5-a011-4b1e28925fd6 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:33.161527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f530e-38c2-448b-ae9a-7dd390f3c1bd None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:33.186837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:33.188109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:33.188776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:33.189260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:33.206342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:33.215379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:33.216863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 74/151] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:33.225985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:33.229809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:33.231500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:33.231796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:33.232095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:33.232952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=2ea08e8a2d62450da554d5efd8fe752c) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:33.233268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:33.234763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:33.249996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 78/152] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:32 2022] GET /identity/v3/role_assignments?user.id=2ea08e8a2d62450da554d5efd8fe752c&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=70a105678f91431a9d75cf7309d9a810 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:33.381320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cfa78-209a-4a07-a7b8-7c59951732c9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:33.423119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:33.424151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:33.424664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:33.425160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:33.426170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:33.426684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:33.428275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:33.450965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 75/153] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:33.457161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:33.630165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab7ea-df77-4eb9-9793-68bd8f5c4930 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:33.682545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:33.687637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:33.687637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:33.687637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] PATH_INFO: `/v3/users/619e869a8cce41b99660f0a2fee25428` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:33.687637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] RBAC: Authorizing `identity:get_user(user_id=619e869a8cce41b99660f0a2fee25428)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:33.688302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:33.690064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 79/154] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:33 2022] GET /identity/v3/users/619e869a8cce41b99660f0a2fee25428 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:33.697068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:33.827982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44a6f4-9340-49b2-9eb1-9ffd3cb88e9c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:33.863958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8da07b-a694-4ded-a869-f78ab238ee89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:33.865235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8da07b-a694-4ded-a869-f78ab238ee89 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:33.865752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8da07b-a694-4ded-a869-f78ab238ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:33.866298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8da07b-a694-4ded-a869-f78ab238ee89 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:33.867767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8da07b-a694-4ded-a869-f78ab238ee89 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:33.869463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8da07b-a694-4ded-a869-f78ab238ee89 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:33.871728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 76/155] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:33 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:33.877139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.036895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a51ce1-5344-4732-9a50-23ed3a0c326c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:34.040191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2b10a-8aa1-43ad-95b5-f79e696d6c9f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.040487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2b10a-8aa1-43ad-95b5-f79e696d6c9f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.040770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2b10a-8aa1-43ad-95b5-f79e696d6c9f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.042754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 77/156] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:34.048684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce7e48-d65e-4e69-b1d1-72ce0094ad32 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.048981 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce7e48-d65e-4e69-b1d1-72ce0094ad32 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.049269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce7e48-d65e-4e69-b1d1-72ce0094ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.072117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c2ce7e48-d65e-4e69-b1d1-72ce0094ad32 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:34.073344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c2ce7e48-d65e-4e69-b1d1-72ce0094ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:34.109239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:34.110647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.111064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.111474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66/users/619e869a8cce41b99660f0a2fee25428/roles/a904b4947b61407fbf6a8e83305b09d6` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.120213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] RBAC: Authorizing `identity:create_grant(project_id=21fde128a0994d3398e451700d576d66, user_id=619e869a8cce41b99660f0a2fee25428, role_id=a904b4947b61407fbf6a8e83305b09d6)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:34.122085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:34.165094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 78/157] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:34.166592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52420b-5f76-483b-8c18-7f7d9b0adf25 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.166811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52420b-5f76-483b-8c18-7f7d9b0adf25 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.167098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52420b-5f76-483b-8c18-7f7d9b0adf25 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.169217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 79/158] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:34.175852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47915-f563-49fd-9404-52d7d56daf99 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.176153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47915-f563-49fd-9404-52d7d56daf99 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.176431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c47915-f563-49fd-9404-52d7d56daf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.199572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-76c47915-f563-49fd-9404-52d7d56daf99 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:34.201057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-76c47915-f563-49fd-9404-52d7d56daf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:34.233178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 80/159] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:33 2022] PUT /identity/v3/projects/21fde128a0994d3398e451700d576d66/users/619e869a8cce41b99660f0a2fee25428/roles/a904b4947b61407fbf6a8e83305b09d6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:34.234179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.320401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:34.321843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d4e38-0a9d-4fe9-9136-eaef2c8c7f2f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.324274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d4e38-0a9d-4fe9-9136-eaef2c8c7f2f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.324592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d4e38-0a9d-4fe9-9136-eaef2c8c7f2f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.326828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 81/161] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:34.333489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.333800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.334091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.359980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:34.361190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:34.400898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd237bef-45ad-4b4b-977e-fcb22629965a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:34.450567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:34.452080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.452426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.453033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.468270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:34.474430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 82/162] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:34.476315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.476421 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:34.477995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 81/163] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:34.483058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.592298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b3119-0d68-4cd6-903e-44ac644b8f38 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:34.614766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590c2a8-d9fd-4d05-937b-2d9d3d6ad405 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:34.630155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:34.631218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.631692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.632690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.643362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:34.652787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:34.654323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 83/164] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:34.659158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.659644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:34.660324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.660613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.660893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.661658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:34.661962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:34.664148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:34.675844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 82/165] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:34.676782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.783099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ded08-5448-4dae-9d06-44932bac8dd1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:34.834694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:34.836087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.836374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.836653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.854709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:34.855919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1652ab-cdf5-4fe9-9726-cd60ccba54b3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:34.861508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:34.870832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 84/166] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:34.871647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:34.890771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:34.891744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:34.892213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:34.892650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:34.893573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:34.894087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:34.895629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:34.904084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 83/167] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:34.909551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.008315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42fb7b-5005-44df-b5a5-7dbf09bd3e5c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.030695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a37af-f51e-41ac-8169-edb9b51c6fd1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.042673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.043588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.044062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.044513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.045440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:35.045913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.047481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.056467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 84/168] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:35.057614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.091593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.093184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.093184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.093184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.098772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.100243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.101939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 85/169] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:34 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:35.102714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.158839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015b2a4-5260-4c9d-9a15-29cd8cac9bf8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.192806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.194022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.195040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.195484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] PATH_INFO: `/v3/users/2ea08e8a2d62450da554d5efd8fe752c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.196866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] RBAC: Authorizing `identity:get_user(user_id=2ea08e8a2d62450da554d5efd8fe752c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.198592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.200479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 85/170] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/users/2ea08e8a2d62450da554d5efd8fe752c => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:35.205733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.305520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd663b9-548b-4595-bd40-35cc0f531acc None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.339231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.340234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.340713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.341185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.352407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7566254-5184-40b9-934d-54bbfbed0e3a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.409412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.411311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.428017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.429489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.429770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.430065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] PATH_INFO: `/v3/users/4889fd0e623346d287cebc77099e6590` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.434900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] RBAC: Authorizing `identity:get_user(user_id=4889fd0e623346d287cebc77099e6590)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.436184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.438204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 86/171] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/users/4889fd0e623346d287cebc77099e6590 => generated 247 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:35.438988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.518759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 86/172] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:35.519591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.618052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7165b-ddb6-44a6-b45b-84ee67b614d0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.652070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.652718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.652996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.653266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.705630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810e410-412d-4be4-ad0c-d89fe6a01c69 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.721879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.723489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.790685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.791366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.791632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.791912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.825478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 87/173] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:35.826654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:35.924367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68611-c244-4350-b941-b73a9b764661 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:35.957510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:35.958327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:35.958605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:35.958877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] PATH_INFO: `/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:35.960769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] RBAC: Authorizing `identity:get_project(project_id=69d8d0d05dfd4ea4adf5c06531baf039)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.962503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.963054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:35.964205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 88/174] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/projects/69d8d0d05dfd4ea4adf5c06531baf039 => generated 312 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:35.964525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:35.965082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:36.065397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f32957-5320-49d3-b4d5-7b9f04b36418 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:36.103502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:36.104375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:36.104653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:36.104922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:36.106888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:36.108329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:36.112718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 89/175] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:36.115373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:36.181090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 87/176] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:36.182073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:36.308815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c11e9-e229-4996-af52-1007440027e5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:36.331727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a8706-c540-4680-9fd8-03ebd4b574d6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:36.364093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:36.364755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:36.365035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:36.365308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:36.366719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=69d8d0d05dfd4ea4adf5c06531baf039, user.id=2ea08e8a2d62450da554d5efd8fe752c) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:36.367028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:36.368479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:36.374542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 90/177] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:36 2022] GET /identity/v3/role_assignments?user.id=2ea08e8a2d62450da554d5efd8fe752c&scope.project.id=69d8d0d05dfd4ea4adf5c06531baf039&role.id=70a105678f91431a9d75cf7309d9a810 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:36.375243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:36.422803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:36.423492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:36.423781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:36.424064 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:36.424926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=4889fd0e623346d287cebc77099e6590) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:36.425242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:36.426803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:36.464052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 88/178] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:36 2022] GET /identity/v3/role_assignments?user.id=4889fd0e623346d287cebc77099e6590&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:36.536675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185e1f6-2d12-4c56-a132-7cd8c9c05a4a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:36.583964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b609f81-d964-451e-b536-feb397c6cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:36.584893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609f81-d964-451e-b536-feb397c6cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:36.585174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609f81-d964-451e-b536-feb397c6cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:36.586480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b609f81-d964-451e-b536-feb397c6cd29 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:36.587870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609f81-d964-451e-b536-feb397c6cd29 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:36.589382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b609f81-d964-451e-b536-feb397c6cd29 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:36.591208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 91/179] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:36 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:36.597469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:36.743339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13889160-03bb-479d-80cd-4c6f45d37dcf None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:36.790578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:36.791242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:36.791781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:36.791781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:36.792685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] RBAC: Adding query filter params (role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=2ea08e8a2d62450da554d5efd8fe752c) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:36.793000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:36.794514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb377cb3-581c-428d-ae9e-1cf9a856656a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:36.807623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 89/180] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:36 2022] GET /identity/v3/role_assignments?user.id=2ea08e8a2d62450da554d5efd8fe752c&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=2481fa0f9e714a879311d70b522a9956 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:37.334596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf853-8bce-4134-8f58-05ba20046421 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.335638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf853-8bce-4134-8f58-05ba20046421 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.335712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bf853-8bce-4134-8f58-05ba20046421 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.337452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 92/181] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:37.343289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b580e-5b2b-40ab-8be0-a87e12f3bd47 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.343765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b580e-5b2b-40ab-8be0-a87e12f3bd47 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.344191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b580e-5b2b-40ab-8be0-a87e12f3bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.365273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-230b580e-5b2b-40ab-8be0-a87e12f3bd47 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:37.366905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-230b580e-5b2b-40ab-8be0-a87e12f3bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:37.455468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 90/182] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:37.481133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bf853-8bce-4134-8f58-05ba20046421 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:37.482040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa612d0-bb2b-4cfe-87a1-6de3a46d3a5d None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.485706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa612d0-bb2b-4cfe-87a1-6de3a46d3a5d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.486273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa612d0-bb2b-4cfe-87a1-6de3a46d3a5d None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.489090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 91/183] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:37.494249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6a25e-4568-4572-9a0a-585532121f34 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.494701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6a25e-4568-4572-9a0a-585532121f34 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.495115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6a25e-4568-4572-9a0a-585532121f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.517743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5fd6a25e-4568-4572-9a0a-585532121f34 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:37.519168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5fd6a25e-4568-4572-9a0a-585532121f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:37.589842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 92/184] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:37.606677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1e0db-b299-4daa-b26b-108cced25f44 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.606967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1e0db-b299-4daa-b26b-108cced25f44 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.607276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1e0db-b299-4daa-b26b-108cced25f44 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.609119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 93/185] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:37.614165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.614456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.614737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.619911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bf853-8bce-4134-8f58-05ba20046421 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:37.630914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:37.632661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:37.656503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:37.657544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.658009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.658432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.659573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:37.661240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:37.667263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 93/186] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:37.667263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:37.702138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 94/187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:37.702948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:37.782999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2b195-6f75-4b99-a208-1a80f2bb6240 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:37.803499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3181ed-dada-493d-877f-3295a6b96977 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:37.815156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:37.815956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.816240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.816516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.826787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:37.833682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:37.835451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 94/188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:37.836221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:37.844338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e21853-ccb3-4bb8-b9ef-6146b7e0b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:37.845257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21853-ccb3-4bb8-b9ef-6146b7e0b26d None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.845688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21853-ccb3-4bb8-b9ef-6146b7e0b26d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.846158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e21853-ccb3-4bb8-b9ef-6146b7e0b26d None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.847267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21853-ccb3-4bb8-b9ef-6146b7e0b26d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:37.849557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e21853-ccb3-4bb8-b9ef-6146b7e0b26d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:37.933054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485489ce-bc65-4e83-a4a3-746549f3d057 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:37.933279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 95/189] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:37 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:37.934666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee3b7-cb27-462d-9ed5-446f5c39801b None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.934969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee3b7-cb27-462d-9ed5-446f5c39801b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.935267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ee3b7-cb27-462d-9ed5-446f5c39801b None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.937091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 96/190] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:37.937884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee3b7-cb27-462d-9ed5-446f5c39801b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:37.975391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1aa22-11b9-4e09-ad17-585a9d4f7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:37.976333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1aa22-11b9-4e09-ad17-585a9d4f7daa None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.976691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1aa22-11b9-4e09-ad17-585a9d4f7daa None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.976973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1aa22-11b9-4e09-ad17-585a9d4f7daa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:37.987997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c1aa22-11b9-4e09-ad17-585a9d4f7daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:37.995791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-50c1aa22-11b9-4e09-ad17-585a9d4f7daa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:37.997088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 95/191] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:37.998423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:37.998714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:37.998996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.016925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:38.018187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:38.062811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ee3b7-cb27-462d-9ed5-446f5c39801b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.087535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 96/192] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:38.099078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.101519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.102227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.102516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.102796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.103565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:38.104653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.105278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.116629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 97/193] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:38.117511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.213212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d79d-99c1-4e3c-92bc-9792e974429e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.239594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750bec-a963-4e58-8b5b-69f6c4d61e3d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.261766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.262472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.263171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.263470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.264503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:38.264814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.266784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.276520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.277082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 97/194] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:38.277698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.278074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.278367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.279176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.292757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:38.300595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:38.302063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 98/195] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:38.302991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.387438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db196d04-fabe-4937-9484-5a4070e73b87 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.422018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.423013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.423345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.423736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] PATH_INFO: `/v3/users/a5750b56adbc405cb2b213248373b7c5` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.428362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362ab43-2613-4c33-9ca0-0f07f4537483 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.438539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] RBAC: Authorizing `identity:get_user(user_id=a5750b56adbc405cb2b213248373b7c5)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.440049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.446450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 98/196] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/users/a5750b56adbc405cb2b213248373b7c5 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:38.447850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.474694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.476405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.476872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.477325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] PATH_INFO: `/v3/users/619e869a8cce41b99660f0a2fee25428` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.478842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=619e869a8cce41b99660f0a2fee25428)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.480559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.482597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 99/197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/users/619e869a8cce41b99660f0a2fee25428 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:38.483603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.550542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f899b-96e5-46c6-861b-714625fabfc7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.583815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.584479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.584788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.585066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.585642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9723ec-c437-4804-8f63-4d8c519f5ce5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.585811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:38.586144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.587570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.595373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 99/198] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:38.600897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.622343 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.623588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.624097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.624719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.700626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.700626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.700869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477470-e40b-4b8a-91f7-87f373b42f4d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.732016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.732766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.733048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.737590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.797900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 100/199] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:38.799050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.807054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.808545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.898662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd1a7-834d-43cd-a26e-c30fb18d2f9e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:38.908896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 100/200] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:38.914861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:38.934444 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:38.935664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:38.936171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:38.936656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] PATH_INFO: `/v3/users/a5750b56adbc405cb2b213248373b7c5` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:38.938133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] RBAC: Authorizing `identity:get_user(user_id=a5750b56adbc405cb2b213248373b7c5)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:38.939800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:38.941722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 101/201] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/users/a5750b56adbc405cb2b213248373b7c5 => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:38.943036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:39.018740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f23cc-463b-48a9-9979-a547985945ae None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.052754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.053652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.053940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.054259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.055515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.057046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.058787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 101/202] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:39.062858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:39.064508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca297e-abd8-46e4-a403-197d61d8960a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.107054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.108571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.109271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.110121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.111835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.113930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.116502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 102/203] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:38 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:39.117534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:39.166671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829f89e-8b88-4f62-a432-1bf64543224d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.202276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.202935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.203216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.203493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.235325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69fa9f-ef2e-4bf5-a369-57a07342942b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.269888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.270553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.270845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.271135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.271980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=a5750b56adbc405cb2b213248373b7c5) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:39.272106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.272857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.274212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.274396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.280457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 103/204] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:39 2022] GET /identity/v3/role_assignments?user.id=a5750b56adbc405cb2b213248373b7c5&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:39.281287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:39.419469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 102/205] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:39.424754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:39.480312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd74fd-6c41-445a-82a0-99f3f733aa58 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.547722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.548717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.549203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.551072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.552126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] RBAC: Adding query filter params (role.id=a904b4947b61407fbf6a8e83305b09d6, scope.project.id=21fde128a0994d3398e451700d576d66, user.id=619e869a8cce41b99660f0a2fee25428) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:39.552668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.555629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.563077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 104/206] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:39 2022] GET /identity/v3/role_assignments?user.id=619e869a8cce41b99660f0a2fee25428&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=a904b4947b61407fbf6a8e83305b09d6 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:39.582830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803969e-09a0-4db7-af69-a827cc4f531a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.644862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9ba4f-1fe5-4e8e-845b-0b58610cefde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.645758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ba4f-1fe5-4e8e-845b-0b58610cefde None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.646064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ba4f-1fe5-4e8e-845b-0b58610cefde None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.646340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9ba4f-1fe5-4e8e-845b-0b58610cefde None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.650866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9ba4f-1fe5-4e8e-845b-0b58610cefde None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.652365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9ba4f-1fe5-4e8e-845b-0b58610cefde None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.654204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 103/207] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:39 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:39.660202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:39.797657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2dc73-3063-4f94-8708-6ba1cd34d78d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:39.836994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:39.838112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:39.838831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:39.839317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:39.840381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] RBAC: Adding query filter params (role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=a5750b56adbc405cb2b213248373b7c5) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:39.840903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:39.842653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a5957-8e90-4f8d-b4eb-b8114116a8c8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:39.849334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 105/208] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:39 2022] GET /identity/v3/role_assignments?user.id=a5750b56adbc405cb2b213248373b7c5&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=2481fa0f9e714a879311d70b522a9956 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:40.463824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d468e1-96b0-4e40-af74-4429cce0a9bd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.464340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d468e1-96b0-4e40-af74-4429cce0a9bd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.464444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d468e1-96b0-4e40-af74-4429cce0a9bd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.466219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 104/209] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:40.474489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fb904-f5d1-48b7-8647-0f05be2ff7ce None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.475902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fb904-f5d1-48b7-8647-0f05be2ff7ce None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.476380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fb904-f5d1-48b7-8647-0f05be2ff7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.495476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-841fb904-f5d1-48b7-8647-0f05be2ff7ce None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:40.496952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-841fb904-f5d1-48b7-8647-0f05be2ff7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:40.570351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 106/210] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:40.593564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d468e1-96b0-4e40-af74-4429cce0a9bd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:40.630513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f0e7-58c8-4e60-89ff-2854c765bde1 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.630804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f0e7-58c8-4e60-89ff-2854c765bde1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.631086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de28f0e7-58c8-4e60-89ff-2854c765bde1 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.633086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 107/211] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:40.637873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.638205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.638489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.655358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:40.656584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:40.701211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d468e1-96b0-4e40-af74-4429cce0a9bd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:40.730327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 108/212] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:40.739559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:40.744381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.744381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.744381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.751553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:40.752909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:40.760945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:40.762503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 105/213] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:40.769767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:40.865212 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04043bd9-526a-4e45-be57-ab16687ee0b2 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:40.868336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406046a1-af4f-4525-afc1-4434df73bab3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:40.901926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:40.902144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:40.902864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.903110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:40.903317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.903699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:40.903800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.904279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:40.904925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:40.905302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:40.905802 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:40.906571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:40.907473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:40.913655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 109/214] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:40.914702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:40.916862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 106/215] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:40.923734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:41.023964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b6819-16ab-4852-b2c4-8f469fa83fa9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:41.038573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7dfc8-d261-45db-ac8f-47fea33e39e3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:41.059536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:41.060457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.060889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.061308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.062191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:41.063792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:41.073230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:41.074408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.074916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.075194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] PATH_INFO: `/v3/users/b8b34b37c86d4f9da17e335dfb832a39` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.089445 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b34b37c86d4f9da17e335dfb832a39)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:41.090947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:41.092682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 107/216] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:40 2022] GET /identity/v3/users/b8b34b37c86d4f9da17e335dfb832a39 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:41.097977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:41.149490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 110/217] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:40 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:41.211633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b47d1-9174-40f9-8fe5-beeecc6c3069 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:41.248853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:41.249942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.250454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.250929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.323102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:41.324611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:41.442116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 108/218] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:50:41.448167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:41.564720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45062b88-b792-46ca-bfb0-151c132e1d56 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:41.599979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5ae37-c7db-499a-b5ad-2642c92478cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:41.601150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ae37-c7db-499a-b5ad-2642c92478cf None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.601615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ae37-c7db-499a-b5ad-2642c92478cf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.602097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5ae37-c7db-499a-b5ad-2642c92478cf None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.603530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5ae37-c7db-499a-b5ad-2642c92478cf None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:41.605170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5ae37-c7db-499a-b5ad-2642c92478cf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:41.607391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 111/219] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:41 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:41.613355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:41.719950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5080a6e-4065-419c-b450-d0d3241f5fc6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:41.759731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:41.760745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.761210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.761665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.762764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=b8b34b37c86d4f9da17e335dfb832a39) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:41.763283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:41.764916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:41.768597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449320aa-6b0d-4f52-9b29-5b6a7ef981eb None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.769100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449320aa-6b0d-4f52-9b29-5b6a7ef981eb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.769556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449320aa-6b0d-4f52-9b29-5b6a7ef981eb None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.771843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 112/220] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:41.776868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:41.777383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:41.777840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:41.784069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 109/221] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:41 2022] GET /identity/v3/role_assignments?user.id=b8b34b37c86d4f9da17e335dfb832a39&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=70a105678f91431a9d75cf7309d9a810 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:41.800756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:41.802305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:41.903586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 113/222] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:41.938821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.054560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713082f7-8fac-4121-a43c-f68ad0d6fd5f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.088181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.089313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.089828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.090396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.101577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:42.109021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:42.110816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 110/223] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:42.116980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.237714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a39cf8e-60d0-4d8b-9dbe-26af42e3e180 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.272065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.273162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.273658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.274185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.275145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:42.275651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:42.277240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461d1c2-aa75-4065-9dfd-36453564b727 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:42.285922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 114/224] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:42.292334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.378361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d54cc-86c5-4e2a-9260-d7b040d2063b None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.379009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d54cc-86c5-4e2a-9260-d7b040d2063b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.379539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d54cc-86c5-4e2a-9260-d7b040d2063b None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.381635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 115/225] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:42.388969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.388969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.388969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.420450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:42.423170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:42.440109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f378d-c69c-4765-946f-4819dd10c9bb None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.497552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.498380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.498658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.498930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] PATH_INFO: `/v3/users/a5750b56adbc405cb2b213248373b7c5` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.500441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] RBAC: Authorizing `identity:get_user(user_id=a5750b56adbc405cb2b213248373b7c5)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:42.501914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:42.504200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 111/226] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:42 2022] GET /identity/v3/users/a5750b56adbc405cb2b213248373b7c5 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:42.508834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.551687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 116/227] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:42.576441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.666255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ae69b-ea65-4103-8a38-0e980ce4a060 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.692843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2658e-f01d-462a-9075-bef238a8aafa None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.711736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.712625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.712908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.713194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.717371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:42.718904 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:42.721181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 112/228] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:42 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:42.727256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.740134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.741402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.741883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.742386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.760105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:42.767797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:42.769031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 117/229] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:42.777317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:42.870098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa1741-44a6-4d39-8551-0462bb9817c4 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.931137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4159129-bdeb-4c54-9b4b-49e0e842736b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:42.938645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.939548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.939835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.940115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/a5750b56adbc405cb2b213248373b7c5/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.942192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] RBAC: Authorizing `identity:create_grant(project_id=1f10995852ac4908a6dff0cbdef9ca55, user_id=a5750b56adbc405cb2b213248373b7c5, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:42.943646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:42.968532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:42.969365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:42.969751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:42.970157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:42.971016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:42.971409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:42.972888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:42.981191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 118/230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:42.986942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:43.041133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 113/231] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:42 2022] PUT /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/a5750b56adbc405cb2b213248373b7c5/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:43.090951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331384cc-c881-4289-936e-d2d6173b25d8 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:43.126878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:43.127750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:43.128031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:43.128308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] PATH_INFO: `/v3/users/a5750b56adbc405cb2b213248373b7c5` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:43.129505 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] RBAC: Authorizing `identity:get_user(user_id=a5750b56adbc405cb2b213248373b7c5)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:43.131126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:43.136744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 119/232] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:42 2022] GET /identity/v3/users/a5750b56adbc405cb2b213248373b7c5 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:43.143110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:43.295350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969733f-ea74-4725-aab0-bc536fe7588a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:43.336901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62446af-1a93-4328-9378-d0b468672bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:43.337791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62446af-1a93-4328-9378-d0b468672bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:43.338127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62446af-1a93-4328-9378-d0b468672bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:43.338408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62446af-1a93-4328-9378-d0b468672bc3 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:43.340301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62446af-1a93-4328-9378-d0b468672bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:43.341775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62446af-1a93-4328-9378-d0b468672bc3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:43.343529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 114/233] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:43 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:43.351905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:43.500249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae250-d17d-434e-8f12-058315d923c2 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:43.536323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a3c74-5862-4560-a59c-8dc642a1c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:43.537553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3c74-5862-4560-a59c-8dc642a1c3d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:43.538609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3c74-5862-4560-a59c-8dc642a1c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:43.539073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a3c74-5862-4560-a59c-8dc642a1c3d6 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/a5750b56adbc405cb2b213248373b7c5/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:43.541484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a3c74-5862-4560-a59c-8dc642a1c3d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f10995852ac4908a6dff0cbdef9ca55, user_id=a5750b56adbc405cb2b213248373b7c5, role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:43.543163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a3c74-5862-4560-a59c-8dc642a1c3d6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:43.665809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 120/234] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:43 2022] PUT /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/a5750b56adbc405cb2b213248373b7c5/roles/2481fa0f9e714a879311d70b522a9956 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:44.210208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed1dc1-7c79-4642-933a-224c6a992836 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.210706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed1dc1-7c79-4642-933a-224c6a992836 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.210807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed1dc1-7c79-4642-933a-224c6a992836 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.212551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 115/235] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:44.218029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.218485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.218908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.239266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcdda1-c7c0-4372-8613-ded6e552a130 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.239884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcdda1-c7c0-4372-8613-ded6e552a130 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.240350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcdda1-c7c0-4372-8613-ded6e552a130 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.242432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:44.243471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 116/236] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:44.245018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:44.248657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.249151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.249616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.274717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:44.277015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:44.366843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 121/237] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:44.387379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 117/238] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:44.403103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:44.432754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:44.546886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141c096-dd7e-4fa1-b06a-72351f3233aa None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:44.586440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c58941-ff9c-42d9-9247-7ad051f9ad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:44.587688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c58941-ff9c-42d9-9247-7ad051f9ad92 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.588440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c58941-ff9c-42d9-9247-7ad051f9ad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.589143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c58941-ff9c-42d9-9247-7ad051f9ad92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.590512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c58941-ff9c-42d9-9247-7ad051f9ad92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:44.590881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07e9c6-bf8c-4a82-8cc6-0360a02feec6 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:44.592477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c58941-ff9c-42d9-9247-7ad051f9ad92 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:44.595026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 122/239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:44.596361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d8d3c-c8b7-4978-831a-d0ec29fe0513 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.596848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d8d3c-c8b7-4978-831a-d0ec29fe0513 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.597293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d8d3c-c8b7-4978-831a-d0ec29fe0513 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.599562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 123/240] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:44.600962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d8d3c-c8b7-4978-831a-d0ec29fe0513 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:44.629230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765736b-4509-4bbc-baea-21d8010c93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:44.630183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765736b-4509-4bbc-baea-21d8010c93cb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.630573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765736b-4509-4bbc-baea-21d8010c93cb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.630921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765736b-4509-4bbc-baea-21d8010c93cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.640851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765736b-4509-4bbc-baea-21d8010c93cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:44.648722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c765736b-4509-4bbc-baea-21d8010c93cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:44.654233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 118/241] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:44.655536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.655897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.656250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.677581 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:44.679225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:44.713477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d8d3c-c8b7-4978-831a-d0ec29fe0513 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:44.750207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:44.750976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.751336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.751751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.752535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:44.752845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 119/242] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:44.753847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:44.763246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:44.856037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 124/243] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:44 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:44.857329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:44.873372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ec0ad-c0d8-414e-b8ff-8496fae3dc24 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:44.913440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:44.914158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:44.914439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:44.914717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:44.915483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:44.915797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:44.917227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:44.926359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 120/244] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:44.943338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:44.994190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f17d8-c926-407d-baad-9585e817e0c1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.034225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.035624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.036079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.036645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.050554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:45.060454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:45.062422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 125/245] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:45.068393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.117709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8418e0f-38ab-4617-8348-19d4ca99e585 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.154036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.155165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.155560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.155940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] PATH_INFO: `/v3/users/5488692fc74b4563bf327f59b49a6ba9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.171097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] RBAC: Authorizing `identity:get_user(user_id=5488692fc74b4563bf327f59b49a6ba9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.172744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.174680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 121/246] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:44 2022] GET /identity/v3/users/5488692fc74b4563bf327f59b49a6ba9 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:45.180822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.193432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4f5f71-071c-4c12-bb3a-c3758851d60c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.232524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.233427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.233857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.234298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.235197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] RBAC: Adding query filter params (name=member) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:45.235670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.237190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.248148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 126/247] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:45.254088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.286939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5578a9-41fb-4187-93b3-0c5e5d000789 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.324572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.325336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.325688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.326077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.357901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155adea-c243-4fa2-9adf-331e1d93389e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.394863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.396092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.396597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.397612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] PATH_INFO: `/v3/users/b8b34b37c86d4f9da17e335dfb832a39` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.399328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b34b37c86d4f9da17e335dfb832a39)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.399446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.400902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.401405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.403344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 127/248] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/users/b8b34b37c86d4f9da17e335dfb832a39 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:45.408772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.510498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 122/249] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:50:45.515223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87497f26-c52a-4f81-9ec1-159638f4ff57 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.516047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.550874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.552071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.552578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.553052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.554515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.556178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.558388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 128/250] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:45.564008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.617492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32226129-62a9-4b8a-be3d-226432bfb500 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.653466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.654288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.654576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.654857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.656066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.657533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.659344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 123/251] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:45.665659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:45.670586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a32d-66d2-492a-979a-0e06d62094fc None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.704569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87706-81ec-4c9c-afa4-86f91903e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.705848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87706-81ec-4c9c-afa4-86f91903e8b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.706374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87706-81ec-4c9c-afa4-86f91903e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.706946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87706-81ec-4c9c-afa4-86f91903e8b0 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/b8b34b37c86d4f9da17e335dfb832a39/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.709172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c87706-81ec-4c9c-afa4-86f91903e8b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f10995852ac4908a6dff0cbdef9ca55, user_id=b8b34b37c86d4f9da17e335dfb832a39, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.711381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c87706-81ec-4c9c-afa4-86f91903e8b0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.772899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b2b93-a292-427a-b0fe-156fd0abe2d7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:45.790490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 129/252] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:45 2022] PUT /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/b8b34b37c86d4f9da17e335dfb832a39/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:50:45.811535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a2d71-99dc-477c-ba34-e39ddeb8e03f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.811845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a2d71-99dc-477c-ba34-e39ddeb8e03f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.812096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a2d71-99dc-477c-ba34-e39ddeb8e03f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.816607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 130/253] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:45.821851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.822276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.822556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.823251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:45.824392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:45.824886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:45.825373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:45.826540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] RBAC: Adding query filter params (role.id=a904b4947b61407fbf6a8e83305b09d6, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=5488692fc74b4563bf327f59b49a6ba9) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:45.827058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:45.828850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:45.837943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 124/254] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/role_assignments?user.id=5488692fc74b4563bf327f59b49a6ba9&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=a904b4947b61407fbf6a8e83305b09d6 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:45.853061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:45.854321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:45.930385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 131/255] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:45.954301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:46.074806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b2cfd-7a38-4191-91fa-1b2ae0fddee2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:46.117197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:46.118103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.118389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.118659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.133805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:46.141084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:50:46.146123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 125/256] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:46.148824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:46.253259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80cf0b-0887-4e09-8e5f-59445a91ac55 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:46.289589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:46.290307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.290590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.290869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.291633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:46.291943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:46.293350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:46.307147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 132/257] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:46.308555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:46.420381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf955-cb6d-452a-a9a0-f5c954f8acda None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:46.465699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9527e40-c07f-4e07-8956-3cbd0f058ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:46.466610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9527e40-c07f-4e07-8956-3cbd0f058ffa None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.466894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9527e40-c07f-4e07-8956-3cbd0f058ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.467167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9527e40-c07f-4e07-8956-3cbd0f058ffa None admin] PATH_INFO: `/v3/users/a5750b56adbc405cb2b213248373b7c5` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.468376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9527e40-c07f-4e07-8956-3cbd0f058ffa None admin] RBAC: Authorizing `identity:get_user(user_id=a5750b56adbc405cb2b213248373b7c5)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:46.469856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9527e40-c07f-4e07-8956-3cbd0f058ffa None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:46.474392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 126/258] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:46 2022] GET /identity/v3/users/a5750b56adbc405cb2b213248373b7c5 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:46.480374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:46.580766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a914a-7347-4403-b647-c438efa02d4d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:46.614514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40361cf1-f830-4fd5-8a47-c2c08a51ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:46.615170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361cf1-f830-4fd5-8a47-c2c08a51ad42 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.615454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361cf1-f830-4fd5-8a47-c2c08a51ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.616353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40361cf1-f830-4fd5-8a47-c2c08a51ad42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.684278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40361cf1-f830-4fd5-8a47-c2c08a51ad42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:46.685753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40361cf1-f830-4fd5-8a47-c2c08a51ad42 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:46.790104 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2eca-d00b-4ac2-95fc-eb98a8249b56 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.790444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2eca-d00b-4ac2-95fc-eb98a8249b56 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.790664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2eca-d00b-4ac2-95fc-eb98a8249b56 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.792724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 127/260] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:46.792831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 133/260] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:46.795100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2eca-d00b-4ac2-95fc-eb98a8249b56 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:46.800325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.800612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.800887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.834091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:46.835250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:46.922091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 134/261] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:46.931448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2eca-d00b-4ac2-95fc-eb98a8249b56 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:46.964473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:46.985119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:46.986389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:46.988266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:46.988808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:46.991349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:46.994090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:47.005140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 128/262] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:46 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:47.023735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:47.162234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc0f844-9a86-494e-9ed2-7b22455ec4d1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:47.202442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef5ba-0a82-41b9-a430-fef009c5274d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:47.242260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:47.243496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:47.243791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:47.244217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:47.244606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:47.244893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:47.245070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:47.245173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:47.246345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=a5750b56adbc405cb2b213248373b7c5) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:47.246857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:47.248512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:47.259560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 129/263] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:47 2022] GET /identity/v3/role_assignments?user.id=a5750b56adbc405cb2b213248373b7c5&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:47.279130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:47.286581 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:47.294087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:47.294418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 135/264] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:47.449302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff3df2-60dc-4dee-b785-41b56885ace6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:47.500630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:47.501318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:47.501605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:47.501884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:47.502675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:47.502986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:47.504392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:47.517452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 130/265] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:47.522514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:47.651894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ced8e-63ff-4096-bb92-45f930a25501 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:47.699634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:47.700442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:47.700731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:47.701011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] PATH_INFO: `/v3/users/a5750b56adbc405cb2b213248373b7c5` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:47.702258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] RBAC: Authorizing `identity:get_user(user_id=a5750b56adbc405cb2b213248373b7c5)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:47.703734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:47.705614 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 136/266] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:47 2022] GET /identity/v3/users/a5750b56adbc405cb2b213248373b7c5 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:47.711316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:47.830350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498980b7-fa7c-4fb0-b071-d6fa90951d2b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:47.872533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:47.873197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:47.873475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:47.873749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:47.954287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:47.955737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:48.058588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 131/267] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:48.064077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:48.195370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b9c3e-5f39-4927-9195-f2a1fc8b15b5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:48.227996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42822d17-e68b-42ae-a868-91bf1bb3ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:48.228776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822d17-e68b-42ae-a868-91bf1bb3ba6b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.229063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822d17-e68b-42ae-a868-91bf1bb3ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.229341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42822d17-e68b-42ae-a868-91bf1bb3ba6b None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.230557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42822d17-e68b-42ae-a868-91bf1bb3ba6b None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:48.232058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42822d17-e68b-42ae-a868-91bf1bb3ba6b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:48.234127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 137/268] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:48 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:48.243289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:48.358420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f288c-db1c-4763-9d5c-af294f4a091e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:48.397374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:48.398051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.398341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.398613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.399435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] RBAC: Adding query filter params (role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=a5750b56adbc405cb2b213248373b7c5) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:48.399800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:48.401242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913e456-0a22-4f95-9ea9-3ae99d883974 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:48.407246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 132/269] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:48 2022] GET /identity/v3/role_assignments?user.id=a5750b56adbc405cb2b213248373b7c5&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=2481fa0f9e714a879311d70b522a9956 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:48.501730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a349-29f7-4241-89e5-b39e4b4c0e0a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.501921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a349-29f7-4241-89e5-b39e4b4c0e0a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.502245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4a349-29f7-4241-89e5-b39e4b4c0e0a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.504126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 138/270] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:48.514820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.515373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.515373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.543213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:48.544440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:48.636824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 133/271] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:48.677397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a349-29f7-4241-89e5-b39e4b4c0e0a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:48.793838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4a349-29f7-4241-89e5-b39e4b4c0e0a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:48.828494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8159c64-525c-4092-bd53-4e86fae481ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:48.829286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159c64-525c-4092-bd53-4e86fae481ad None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.829568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159c64-525c-4092-bd53-4e86fae481ad None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.829842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8159c64-525c-4092-bd53-4e86fae481ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.840971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8159c64-525c-4092-bd53-4e86fae481ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:48.847986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-b8159c64-525c-4092-bd53-4e86fae481ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:48.849527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 139/272] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:48.854965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:48.883486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6caf7c-bfdf-48b6-8b49-df3009425bb1 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.883486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6caf7c-bfdf-48b6-8b49-df3009425bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.883486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6caf7c-bfdf-48b6-8b49-df3009425bb1 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.883486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 140/273] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:48.888348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:48.888843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:48.889281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:48.906938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:48.908403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:48.987344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5db9-ff00-4cef-8792-b3d5cdb2974a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:48.994393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 141/274] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:49.016542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.029783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.030740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.031195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.031662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.032572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:49.033072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.034680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.044076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 134/275] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:49.049531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.129561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318c861-20cf-4bad-9d98-aedd7bbfddf3 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.169200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb949f-69b6-4ba0-9fcc-2d87b7511f4f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.170050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.170934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.171284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.171766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.173706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.175254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.177239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 142/276] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:49.183017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.206700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.207958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.208440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.208911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] PATH_INFO: `/v3/users/3e105fee36274f61ab3017403fca77ea` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.223375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105fee36274f61ab3017403fca77ea)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.225184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.231967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 135/277] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/users/3e105fee36274f61ab3017403fca77ea => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:49.233055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.281033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f26c8b-2a5d-4a4b-898f-01af32f84bdd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.315477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de96f9-58f8-4835-b368-02eb8ec6e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.316060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de96f9-58f8-4835-b368-02eb8ec6e2bf None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.316340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de96f9-58f8-4835-b368-02eb8ec6e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.316610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de96f9-58f8-4835-b368-02eb8ec6e2bf None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.317316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de96f9-58f8-4835-b368-02eb8ec6e2bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.319471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de96f9-58f8-4835-b368-02eb8ec6e2bf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.333460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c613d-4d4e-442c-8a6c-1ac5fa77f6d5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.366092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.366760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.367044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.367319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.368145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, user.id=3e105fee36274f61ab3017403fca77ea, scope.system=all) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:49.368447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.369892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e53eb5-9ef0-4941-a655-546d31758b1b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.374715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 136/278] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/role_assignments?user.id=3e105fee36274f61ab3017403fca77ea&scope.system=all&role.id=70a105678f91431a9d75cf7309d9a810 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:49.375897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e576c-cc84-48ae-8fd8-d8fd44fcd7b4 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.376171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e576c-cc84-48ae-8fd8-d8fd44fcd7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.376449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e576c-cc84-48ae-8fd8-d8fd44fcd7b4 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.378127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 137/279] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:49.379279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a680a32-285e-4ed4-a38b-fed85ce71523 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.379564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a680a32-285e-4ed4-a38b-fed85ce71523 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.379836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a680a32-285e-4ed4-a38b-fed85ce71523 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.382324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 138/280] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:49.384482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.384770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.385048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.403273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:49.404484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:49.432132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 143/281] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:50:49 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:50:49.432132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.432132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.432132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.469106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:49.470599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:49.500950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 139/282] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:49.522694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.567771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 144/283] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:49.591415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.645898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0df32-7bf5-444b-8a0c-d2a30d389c88 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.688841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.690079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.690567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.691037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.706216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:49.713649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:49.728183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:49.728307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f64b1a-9af7-4ec6-a2e0-04fc5b82524d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.728386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.761717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.762659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.763006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.763343 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.774785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:49.782030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:49.783491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:49.789761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.838196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83401-d9d4-48fa-9619-e9d8d0943569 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.889279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.889949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.890287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.890564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.891560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:49.891664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.894116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.904344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 141/286] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:49.909170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:49.910995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e1d77-6567-41ea-9241-00686aca8b96 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:49.951900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:49.952596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:49.952882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:49.953157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:49.953998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] RBAC: Adding query filter params (name=member) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:49.954487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:49.955599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:49.964852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 146/287] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:49.970279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:50.024392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad02f2b-5e31-46a2-899a-c6caf6dfdae9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.067129 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.067998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.068270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.068534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] PATH_INFO: `/v3/users/5488692fc74b4563bf327f59b49a6ba9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.072623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] RBAC: Authorizing `identity:get_user(user_id=5488692fc74b4563bf327f59b49a6ba9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.075467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.077128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 142/288] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/users/5488692fc74b4563bf327f59b49a6ba9 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:50.082852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:50.105470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819d37-d19c-4832-a3cd-acd75d129835 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.166669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.167584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.167870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.168144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] PATH_INFO: `/v3/users/b8b34b37c86d4f9da17e335dfb832a39` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.174764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] RBAC: Authorizing `identity:get_user(user_id=b8b34b37c86d4f9da17e335dfb832a39)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.176241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.178028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 147/289] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:49 2022] GET /identity/v3/users/b8b34b37c86d4f9da17e335dfb832a39 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:50.183113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:50.239382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bd7b9-b907-4185-8e84-7a0666d91f6f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.314680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.315637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.315838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.316112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.317342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.319384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.321275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 143/290] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:50 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:50.338172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:50.340919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2fde-1ee3-4fa7-b845-8c6b532c3bfd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.378112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.380382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.382074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.383197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.481027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.482654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.548758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97836d73-f7a5-4ee8-af74-975e0db54129 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.582601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 148/291] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:50:50.590956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:50.600582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.601782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.602289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.602762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/5488692fc74b4563bf327f59b49a6ba9/roles/a904b4947b61407fbf6a8e83305b09d6` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.604974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f10995852ac4908a6dff0cbdef9ca55, user_id=5488692fc74b4563bf327f59b49a6ba9, role_id=a904b4947b61407fbf6a8e83305b09d6)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.606753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.700991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7b125-cce5-48db-8baf-88aaa3f255b7 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.703530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 144/292] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:50:50 2022] PUT /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/users/5488692fc74b4563bf327f59b49a6ba9/roles/a904b4947b61407fbf6a8e83305b09d6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:50:50.742276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3ab69-0147-4521-94f4-d225137cfc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.743159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3ab69-0147-4521-94f4-d225137cfc12 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.743442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3ab69-0147-4521-94f4-d225137cfc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.743717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3ab69-0147-4521-94f4-d225137cfc12 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.744941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3ab69-0147-4521-94f4-d225137cfc12 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.746449 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3ab69-0147-4521-94f4-d225137cfc12 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.748369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 149/293] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:50 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:50.754503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:50.913398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794372c-7fe2-4a8f-af97-6800c1264778 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:50.951776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:50.952376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:50.952664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:50.952939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:50.953771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=b8b34b37c86d4f9da17e335dfb832a39) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:50.954122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:50.955573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1ecc6-cdf8-4259-ba2b-30550c6ef5a2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:50.964890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 145/294] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:50 2022] GET /identity/v3/role_assignments?user.id=b8b34b37c86d4f9da17e335dfb832a39&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=70a105678f91431a9d75cf7309d9a810 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:51.895514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da6175-9e61-405e-87d4-23c66230ee70 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:51.896070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da6175-9e61-405e-87d4-23c66230ee70 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:51.896070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da6175-9e61-405e-87d4-23c66230ee70 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:51.898430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 150/295] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:51.903724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:51.904521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:51.904999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:51.922502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:51.923959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:51.994699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 146/296] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:52.018788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da6175-9e61-405e-87d4-23c66230ee70 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.119805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da6175-9e61-405e-87d4-23c66230ee70 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.156771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4635d17-8944-4179-bbb2-3de13b1f0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.157898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4635d17-8944-4179-bbb2-3de13b1f0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.158415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4635d17-8944-4179-bbb2-3de13b1f0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.158879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4635d17-8944-4179-bbb2-3de13b1f0e0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.170187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4635d17-8944-4179-bbb2-3de13b1f0e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:52.177416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-b4635d17-8944-4179-bbb2-3de13b1f0e0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:52.179206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 151/297] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:52.185035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.192133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4f7b-ee6d-4df1-aea1-73067a5d25f4 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.192438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4f7b-ee6d-4df1-aea1-73067a5d25f4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.192714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb4f7b-ee6d-4df1-aea1-73067a5d25f4 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.194814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 152/298] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:52.199606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.199897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.200173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.218392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:52.219906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:52.292394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 153/299] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:52.305829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f872dd0-acc2-44da-936d-8739e8427a2b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.314972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.346166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.348022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.348671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.349141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.350936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:52.351436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:52.353412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ce433-5821-4ddd-aece-1c82ee896ead None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:52.366005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 147/300] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:52.366005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117aaa-6d6c-4630-b222-70907ed114dd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.366005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117aaa-6d6c-4630-b222-70907ed114dd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.366005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117aaa-6d6c-4630-b222-70907ed114dd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.366005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 148/301] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:52.370041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117aaa-6d6c-4630-b222-70907ed114dd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.415888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486c7b6-4302-4bc5-8c0d-8e3e6feb4910 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.448190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de6a6d-053f-4b25-a722-d72335f7cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.449010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de6a6d-053f-4b25-a722-d72335f7cc95 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.449287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de6a6d-053f-4b25-a722-d72335f7cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.449562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de6a6d-053f-4b25-a722-d72335f7cc95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.460171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de6a6d-053f-4b25-a722-d72335f7cc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:52.467172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-29de6a6d-053f-4b25-a722-d72335f7cc95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:52.468374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 154/302] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:52.469532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.469817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.470120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.477349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117aaa-6d6c-4630-b222-70907ed114dd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.487952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:52.489121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:52.512839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.513867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.514318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.514594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] PATH_INFO: `/v3/users/3e105fee36274f61ab3017403fca77ea` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.515757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] RBAC: Authorizing `identity:get_user(user_id=3e105fee36274f61ab3017403fca77ea)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:52.517197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:52.523844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 149/303] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/users/3e105fee36274f61ab3017403fca77ea => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:52.523844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.566033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 155/304] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:52.566033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.625063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb2662-c4e2-4ff7-bf09-db5de6bb5d5f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.656269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.656931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.657209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.657481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.658239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:52.658539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:52.659899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:52.668755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 150/305] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:52.669346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692598-7bb6-46e0-9d7b-0898534895fb None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.669892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.703445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.704303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.704662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.704957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] PATH_INFO: `/v3/system/users/3e105fee36274f61ab3017403fca77ea/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.706501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e105fee36274f61ab3017403fca77ea, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:52.707902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:52.763366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 156/306] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Apr 26 13:50:52 2022] PUT /identity/v3/system/users/3e105fee36274f61ab3017403fca77ea/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:50:52.764315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.838522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddb83c-697e-4a12-b909-05e020e54b53 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.874322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986fd62-3e1d-4731-b164-ac20560941b4 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:52.884004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.884824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.885106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.885384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.886697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:52.888288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:52.894399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 151/307] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:52.896315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:52.915498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:52.916435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:52.916719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:52.916996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] PATH_INFO: `/v3/users/1b35a05e7984499c8646f1b1bb9f3a38` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:52.932564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1b35a05e7984499c8646f1b1bb9f3a38)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:52.933822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:52.936136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 157/308] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/users/1b35a05e7984499c8646f1b1bb9f3a38 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:52.941314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:53.013448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ea1b0-0515-4e15-b5ed-f3748a9d74a1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:53.050968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed675d-88ff-421f-b6bc-887db91d25b0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:53.058615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b6b2d-0b7a-44ac-986e-d245cd4f1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:53.059723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6b2d-0b7a-44ac-986e-d245cd4f1f5f None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.060014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6b2d-0b7a-44ac-986e-d245cd4f1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.060297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6b2d-0b7a-44ac-986e-d245cd4f1f5f None admin] PATH_INFO: `/v3/groups` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.061369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b6b2d-0b7a-44ac-986e-d245cd4f1f5f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:53.063449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b6b2d-0b7a-44ac-986e-d245cd4f1f5f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:53.085713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:53.086443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.086732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.087032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.087879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] RBAC: Adding query filter params (role.id=a904b4947b61407fbf6a8e83305b09d6, user.id=1b35a05e7984499c8646f1b1bb9f3a38, scope.system=all) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:53.088195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:53.089609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338a45-772e-4bac-82b2-0ff552ca2ea7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:53.101995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 158/309] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 26 13:50:52 2022] GET /identity/v3/role_assignments?user.id=1b35a05e7984499c8646f1b1bb9f3a38&scope.system=all&role.id=a904b4947b61407fbf6a8e83305b09d6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:53.139912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 152/310] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Apr 26 13:50:52 2022] POST /identity/v3/groups => generated 229 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:53.330674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46502232-6790-4234-b523-8f3553dc6200 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.331069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46502232-6790-4234-b523-8f3553dc6200 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.331245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46502232-6790-4234-b523-8f3553dc6200 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.333161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 159/311] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:53.339416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.339707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.339982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.357620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:53.359070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:53.425155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 153/312] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:53.449757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46502232-6790-4234-b523-8f3553dc6200 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:53.558485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46502232-6790-4234-b523-8f3553dc6200 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:53.595362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:53.596091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.596379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.596657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.607326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:53.614393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:53.616492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 160/313] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:53.624097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:53.725443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178efe41-5f5d-415f-b55d-eb98f0d9f142 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:53.759943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:53.760609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.760894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.761172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.761914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:53.762245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:53.763618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:53.772182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 154/314] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:53.777605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:53.885043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb586a0-b4ef-4c73-910e-a7a6894b29ca None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:53.920442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:53.921327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:53.921613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:53.921892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] PATH_INFO: `/v3/users/5488692fc74b4563bf327f59b49a6ba9` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:53.923149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] RBAC: Authorizing `identity:get_user(user_id=5488692fc74b4563bf327f59b49a6ba9)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:53.924603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:53.926499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 161/315] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:53 2022] GET /identity/v3/users/5488692fc74b4563bf327f59b49a6ba9 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:53.932369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:54.040161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b4085-2146-4a20-a2ac-a8976c89e2cf None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:54.073225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:54.073866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:54.074171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:54.074445 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:54.139878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:54.141268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:54.236938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 155/316] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:54.242793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:54.348202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46faa5e7-2322-4648-b49c-ba4392066105 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:54.384599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025924f-c5eb-415d-a601-8e0226ed49a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:54.385803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025924f-c5eb-415d-a601-8e0226ed49a0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:54.386315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025924f-c5eb-415d-a601-8e0226ed49a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:54.386817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025924f-c5eb-415d-a601-8e0226ed49a0 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:54.388211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025924f-c5eb-415d-a601-8e0226ed49a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:54.389854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025924f-c5eb-415d-a601-8e0226ed49a0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:54.392144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 162/317] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:54 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:54.398430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:54.503759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec50a64-899b-49ae-87f9-fe8b6854c41c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:54.536758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:54.538343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:54.538703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:54.538981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:54.539799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] RBAC: Adding query filter params (role.id=a904b4947b61407fbf6a8e83305b09d6, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55, user.id=5488692fc74b4563bf327f59b49a6ba9) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:54.540104 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:54.541529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88254-a975-47bf-bfad-d26bfcddf132 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:54.547696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 156/318] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:50:54 2022] GET /identity/v3/role_assignments?user.id=5488692fc74b4563bf327f59b49a6ba9&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=a904b4947b61407fbf6a8e83305b09d6 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:55.170476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987d11-48b6-4247-abd3-0c419327ecef None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.171022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987d11-48b6-4247-abd3-0c419327ecef None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.171022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d987d11-48b6-4247-abd3-0c419327ecef None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.173119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 163/319] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:55.179298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ffd30-2ab8-41f5-bc82-5aba97582a91 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.179853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ffd30-2ab8-41f5-bc82-5aba97582a91 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.179853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ffd30-2ab8-41f5-bc82-5aba97582a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.197364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-828ffd30-2ab8-41f5-bc82-5aba97582a91 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:55.198586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-828ffd30-2ab8-41f5-bc82-5aba97582a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:55.272558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 157/320] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:55.295775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987d11-48b6-4247-abd3-0c419327ecef None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:55.460563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9a0c7-4e97-41b7-9030-c4e8b9018855 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.460851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9a0c7-4e97-41b7-9030-c4e8b9018855 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.461127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9a0c7-4e97-41b7-9030-c4e8b9018855 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.463079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 158/321] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:55.467851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f3fc7-66a8-4cc0-b38c-edb7f4acfd7f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.468207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f3fc7-66a8-4cc0-b38c-edb7f4acfd7f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.468552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f3fc7-66a8-4cc0-b38c-edb7f4acfd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.485511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-015f3fc7-66a8-4cc0-b38c-edb7f4acfd7f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:55.486715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-015f3fc7-66a8-4cc0-b38c-edb7f4acfd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:55.524501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d987d11-48b6-4247-abd3-0c419327ecef None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:55.554461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 159/322] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:55.555780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd2f6e-3bb7-4ca9-bcfd-d88840825632 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.556061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd2f6e-3bb7-4ca9-bcfd-d88840825632 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.556339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd2f6e-3bb7-4ca9-bcfd-d88840825632 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.558327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 160/323] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:55.564490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:55.565071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.565356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.565632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.565948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.566391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.566818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.576292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:55.583280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:55.584550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 164/324] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:55.585320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:55.589921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:55.591662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:55.654645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 161/325] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:55.655470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:55.680505 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff326-729c-4649-8982-d45f8560f4e1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:55.711810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:55.712527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.712807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.713080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.722634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:55.730004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:50:55.731167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 165/326] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:55.731964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:55.750330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3abc-71ac-40b6-ac45-3461fa5f9b9d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:55.831296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c43d8-c301-418e-a8a6-55ce8370c838 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:55.866148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:55.866957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.867244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.867520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.868708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:55.870187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:55.874847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 166/327] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:55.874847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:55.897461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:55.898165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:55.898450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:55.898720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:55.899467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:55.899771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:55.901147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:55.908941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 162/328] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:55.909699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:55.969749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2afe-3565-4479-9cd3-f71e36e1cb09 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:56.001079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:56.001748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:56.002060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:56.002341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:56.002622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f1320-8e07-4273-905c-8e374dfca3a6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:56.003087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:56.003396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:56.004755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:56.012533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 167/329] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:56.013528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:56.034926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:56.035686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:56.036040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:56.036388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] PATH_INFO: `/v3/groups` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:56.037130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:56.039452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:56.106815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc922cb-bee8-4d59-934a-a1cc889dac16 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:56.137704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 163/330] 10.222.0.23 () {60 vars in 1134 bytes} [Tue Apr 26 13:50:55 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:50:56.137837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:56.138561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:56.138687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:56.138972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:56.139249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] PATH_INFO: `/v3/users/3e105fee36274f61ab3017403fca77ea` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:56.140374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] RBAC: Authorizing `identity:get_user(user_id=3e105fee36274f61ab3017403fca77ea)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:56.141827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:56.143788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 168/331] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:56 2022] GET /identity/v3/users/3e105fee36274f61ab3017403fca77ea => generated 293 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:56.150509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:56.244413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dc9dc-0b5e-4992-8d87-86a43318087b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:56.258927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd755b07-a7ca-41fb-918f-d831e2b52b99 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:56.279138 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:56.280027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:56.280308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:56.280581 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] PATH_INFO: `/v3/users/1b35a05e7984499c8646f1b1bb9f3a38` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:56.281841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] RBAC: Authorizing `identity:get_user(user_id=1b35a05e7984499c8646f1b1bb9f3a38)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:56.283405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:56.285296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 164/332] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:50:56 2022] GET /identity/v3/users/1b35a05e7984499c8646f1b1bb9f3a38 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:50:56.291366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:56.297348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:56.298060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:56.298352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:56.298630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:56.299477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] RBAC: Adding query filter params (role.id=70a105678f91431a9d75cf7309d9a810, user.id=3e105fee36274f61ab3017403fca77ea, scope.system=all) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:56.299788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:56.301851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3d97c-4299-4ce0-828f-c06f68e12361 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:56.318315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 169/333] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 26 13:50:56 2022] GET /identity/v3/role_assignments?user.id=3e105fee36274f61ab3017403fca77ea&scope.system=all&role.id=70a105678f91431a9d75cf7309d9a810 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:56.404087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c7c65-4ee9-47de-8039-4f643bf6df3e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:56.448553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd5b7-411d-4df6-b117-2cbaf836e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:56.449447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd5b7-411d-4df6-b117-2cbaf836e292 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:56.449728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd5b7-411d-4df6-b117-2cbaf836e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:56.450946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd5b7-411d-4df6-b117-2cbaf836e292 None admin] PATH_INFO: `/v3/system/users/1b35a05e7984499c8646f1b1bb9f3a38/roles/a904b4947b61407fbf6a8e83305b09d6` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:56.452478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dd5b7-411d-4df6-b117-2cbaf836e292 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1b35a05e7984499c8646f1b1bb9f3a38, role_id=a904b4947b61407fbf6a8e83305b09d6)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:56.453075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dd5b7-411d-4df6-b117-2cbaf836e292 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:56.541091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 165/334] 10.222.0.23 () {58 vars in 1334 bytes} [Tue Apr 26 13:50:56 2022] PUT /identity/v3/system/users/1b35a05e7984499c8646f1b1bb9f3a38/roles/a904b4947b61407fbf6a8e83305b09d6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:50:58.970247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510244-abd0-4f82-bf5c-f4f31f13d898 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:58.971280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510244-abd0-4f82-bf5c-f4f31f13d898 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:58.971771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97510244-abd0-4f82-bf5c-f4f31f13d898 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:58.974119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 170/335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:50:58.983532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:58.984446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:58.984976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.007493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:59.012792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:59.092638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 166/336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:50:59.132937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510244-abd0-4f82-bf5c-f4f31f13d898 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:59.247847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97510244-abd0-4f82-bf5c-f4f31f13d898 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:59.282470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea95fe3-c6a5-4770-8c7b-7e298bd853a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:59.285540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95fe3-c6a5-4770-8c7b-7e298bd853a5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:59.285540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95fe3-c6a5-4770-8c7b-7e298bd853a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:59.285540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea95fe3-c6a5-4770-8c7b-7e298bd853a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.295528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea95fe3-c6a5-4770-8c7b-7e298bd853a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:59.303255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6ea95fe3-c6a5-4770-8c7b-7e298bd853a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:50:59.304769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 171/337] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:50:59.310698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:59.368772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1f76-a6d8-4b60-9850-999a8a8455c0 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:59.369073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1f76-a6d8-4b60-9850-999a8a8455c0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:59.369339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea1f76-a6d8-4b60-9850-999a8a8455c0 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.371193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 172/338] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:50:59.389750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:59.389750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:59.389750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.420407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:50:59.421989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:50:59.428875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c70da-b2b6-4a7a-9d59-839348bf2776 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:59.482687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:59.483457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:59.483737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:59.484013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.484826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:50:59.485142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:59.486603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:59.502003 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 167/339] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:50:59.508578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:59.552697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:50:59.602299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:59.637719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f894ee-0377-48e2-85e2-779efd8e3f7d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:59.679259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:59.679922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:59.680206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:59.680481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.728959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ed641-3389-4a25-867b-32ca1fca8a3b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:59.771267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:50:59.773570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:50:59.777666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:50:59.778540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:50:59.778820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:50:59.779091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:50:59.798630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:50:59.810534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:50:59.812257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 174/341] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:50:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:50:59.817631 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:59.877814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 168/342] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:50:59.883612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:50:59.964196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af84be-0e2f-4010-8576-78ec466c5d66 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:50:59.998052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fca2f2-b4b0-43f1-b544-194c4a5e09d6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.001588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.002336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.002615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.002889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.003692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:00.004002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:00.005379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:00.023936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 175/343] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:50:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:00.029151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.047233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.048208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.048558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.048898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.054700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:00.056229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:00.058392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 169/344] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:50:59 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:00.063535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.132098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3f5c4-6a54-473b-b5a8-d36417ff4f34 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.174500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e30bf-3a57-47a4-8aec-e989d5a64c8c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.175598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c4b19-85af-459a-a1a1-14fd624baa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.176263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c4b19-85af-459a-a1a1-14fd624baa69 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.176541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c4b19-85af-459a-a1a1-14fd624baa69 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.177006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c4b19-85af-459a-a1a1-14fd624baa69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.214301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46f76-64cd-4de2-bffe-633690012282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.215493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46f76-64cd-4de2-bffe-633690012282 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.215959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46f76-64cd-4de2-bffe-633690012282 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.216423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46f76-64cd-4de2-bffe-633690012282 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.229661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46f76-64cd-4de2-bffe-633690012282 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:00.231430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d46f76-64cd-4de2-bffe-633690012282 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:00.233683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 170/345] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:00.235210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d47b31-37d9-4b41-a5c3-fbdf67d285d2 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.235706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d47b31-37d9-4b41-a5c3-fbdf67d285d2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.236171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d47b31-37d9-4b41-a5c3-fbdf67d285d2 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.238066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 171/346] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:00.239434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de5bc-ca4a-421b-b718-72f61ce3a2b1 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.239916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de5bc-ca4a-421b-b718-72f61ce3a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.240405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de5bc-ca4a-421b-b718-72f61ce3a2b1 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.242313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 172/347] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:00.245117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.245643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.246324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.269235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c4b19-85af-459a-a1a1-14fd624baa69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:00.271016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:00.272623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c4b19-85af-459a-a1a1-14fd624baa69 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:00.273248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:00.346029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 173/348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:00.347388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.384253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 176/349] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:51:00.385582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a4536-168e-480c-9702-dbed185172d6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.385875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a4536-168e-480c-9702-dbed185172d6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.390275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a4536-168e-480c-9702-dbed185172d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.408700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-247a4536-168e-480c-9702-dbed185172d6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:00.409877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-247a4536-168e-480c-9702-dbed185172d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:00.474598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725c476-8d74-45fe-9458-9924411265d9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.507043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 177/350] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:00.508777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886355f9-8ba4-41b1-8b2f-3ade495d81af None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.509164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886355f9-8ba4-41b1-8b2f-3ade495d81af None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.509448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886355f9-8ba4-41b1-8b2f-3ade495d81af None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.511578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 178/351] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:00.512293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886355f9-8ba4-41b1-8b2f-3ade495d81af None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.518142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.519024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.519451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.519861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.520829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=21fde128a0994d3398e451700d576d66) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:00.521284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:00.522917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:00.529706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 174/352] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=70a105678f91431a9d75cf7309d9a810 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:00.530666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.659220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886355f9-8ba4-41b1-8b2f-3ade495d81af None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.676303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7965e-7990-4afc-bcc6-583f824084a7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.711843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.712850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.713142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.713419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.721824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926fee1-bf15-4b74-b04f-56f4271db81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.723118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926fee1-bf15-4b74-b04f-56f4271db81b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.723561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926fee1-bf15-4b74-b04f-56f4271db81b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.724034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926fee1-bf15-4b74-b04f-56f4271db81b None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.726150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926fee1-bf15-4b74-b04f-56f4271db81b None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:00.726721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:00.728080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926fee1-bf15-4b74-b04f-56f4271db81b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:00.730471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 175/353] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:00.731910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b821163-68b6-4998-9134-20856bd7574d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.732349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b821163-68b6-4998-9134-20856bd7574d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.732768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b821163-68b6-4998-9134-20856bd7574d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.733727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 26 13:51:00.734974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 179/354] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:00.735745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.752937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3b821163-68b6-4998-9134-20856bd7574d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:00.754567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3b821163-68b6-4998-9134-20856bd7574d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:00.856227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b27d8c-f21f-4345-bcc4-da2348a4b104 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:00.857551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 176/355] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:00.861631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b821163-68b6-4998-9134-20856bd7574d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.913784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:00.914989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:00.915493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:00.915977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:00.927088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:00.937788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:51:00.939349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 180/356] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:00.940430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:00.971990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b821163-68b6-4998-9134-20856bd7574d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.008449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.009330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.009593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.009857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.011063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.012558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.014412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 177/357] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.014874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.050284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358fb2b-1cae-4462-a6e0-b6f5174cf711 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.085609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.086688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.087177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.087657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.088626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:01.089154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.090787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.100102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 181/358] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:51:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.101947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.117459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f28c6-8986-4ae3-9660-fa302aa271c1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.151113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.151922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.152200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.152470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.164532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:01.171400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:51:01.172609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 178/359] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:01.173390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.206647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5f91-f780-4372-8a4a-02fb7b8c4354 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.242743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.243858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.244369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.244864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.245835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:01.246391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.248039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.257003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 182/360] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.258193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.277205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c3385-3372-4957-a8a1-f5dee0432c6b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.311929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.312585 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.312869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.313137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.313956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=21fde128a0994d3398e451700d576d66) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:01.314288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.315729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.323957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 179/361] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=2481fa0f9e714a879311d70b522a9956 => generated 260 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.325162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.378964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a34cb6-6299-4d96-aba5-abe5fab73279 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.439009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.440120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.440895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.441175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] PATH_INFO: `/v3/users/1b35a05e7984499c8646f1b1bb9f3a38` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.442774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] RBAC: Authorizing `identity:get_user(user_id=1b35a05e7984499c8646f1b1bb9f3a38)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.446002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.448071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 183/362] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/users/1b35a05e7984499c8646f1b1bb9f3a38 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.451530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.462468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970336-ae16-4b19-89bf-87dc2e5f73c7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.500377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.501062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.501346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.501621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.502444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:01.502744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.504164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6626d1-813b-4c43-a44d-4fab3685a64f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.514982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 180/363] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.516367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f30c9-1504-4824-960b-40560d3660cf None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.516657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f30c9-1504-4824-960b-40560d3660cf None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.516933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f30c9-1504-4824-960b-40560d3660cf None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.519563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 181/364] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:01.520413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f30c9-1504-4824-960b-40560d3660cf None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.592615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772e5b7-47e7-413f-8bba-294109c6aa9e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.636836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f30c9-1504-4824-960b-40560d3660cf None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.641723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f34fa-5450-4fc4-83c6-74797a26d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.642420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f34fa-5450-4fc4-83c6-74797a26d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.642708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f34fa-5450-4fc4-83c6-74797a26d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.642987 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f34fa-5450-4fc4-83c6-74797a26d7f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.673593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.674668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.675172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.675650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.676674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] RBAC: Adding query filter params (role.id=a904b4947b61407fbf6a8e83305b09d6, user.id=1b35a05e7984499c8646f1b1bb9f3a38, scope.system=all) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:01.677200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.678939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.691761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 182/365] 10.222.0.23 () {56 vars in 1308 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/role_assignments?user.id=1b35a05e7984499c8646f1b1bb9f3a38&scope.system=all&role.id=a904b4947b61407fbf6a8e83305b09d6 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:01.692885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:01.727487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f34fa-5450-4fc4-83c6-74797a26d7f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:01.729245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f34fa-5450-4fc4-83c6-74797a26d7f4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:01.848847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 184/366] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:01.850809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:01.851107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:01.851444 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:01.890587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:01.891809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:01.943215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a8f0-11d6-42c6-a35b-43ca67b91d76 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:01.998444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:01.999605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.000363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.001066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.015873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 185/367] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:02.016939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.092031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.093627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.141060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3ad81-e9ea-4203-ae86-5badc6fadf9b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.177100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.178766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.179198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.179644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.181003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.182687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.184918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 186/368] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:02.185887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.200322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 183/369] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:02.201199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.289813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ec99-87ae-4bbe-bf0b-09db5f299474 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.306527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7385-e2a3-418a-a78d-1db98e2857d9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.325293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.326437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.326908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.327405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.338258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:02.341134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.342043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.342329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.342603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.343795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.345237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.346893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 184/370] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:02.347336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:02.347656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.349229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 187/371] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:02.355043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.463513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c808e-29fb-407b-b66a-6229b28ce3e5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.486049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7de3d-e4dc-43c4-9cba-ad16a1630655 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.506185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.507329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.507819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.508236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.509549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.511185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.513027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 185/372] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:02.513934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.537717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.538997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.539287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.539569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.540416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:02.540733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.543739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.552076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 188/373] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=2481fa0f9e714a879311d70b522a9956 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:02.553861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.649661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc7479-c7ca-4258-b872-df87bc330490 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.703905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.706079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.707275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.708413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.710388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:02.712543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19f9e5-3f0f-4f8a-b685-a2af67085d39 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.713155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.714858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.734478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 186/374] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:02.741037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.768030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.768619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.768906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.769186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.770429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.772446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.774075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 189/375] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:02.780159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:02.878120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6844749-7235-4013-84aa-58d229f5cbb8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.907613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e8ec0-783c-41f0-950a-ba52979e30a4 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:02.918538 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.919330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.920016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.920298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.954124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:02.955439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:02.955906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:02.956339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:02.957348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:02.957670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:02.961005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:02.968589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 190/376] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=70a105678f91431a9d75cf7309d9a810 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:03.009651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:03.011254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:03.120516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 187/377] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:03.125920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:03.264686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd9c73-72a4-46ee-a3c2-2572cb7422aa None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:03.305245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c935e-ae83-4eba-b1c7-79f9ac6db121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:03.306142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c935e-ae83-4eba-b1c7-79f9ac6db121 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.306433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c935e-ae83-4eba-b1c7-79f9ac6db121 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.306717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c935e-ae83-4eba-b1c7-79f9ac6db121 None admin] PATH_INFO: `/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.307929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c935e-ae83-4eba-b1c7-79f9ac6db121 None admin] RBAC: Authorizing `identity:get_project(project_id=5c5b2c20b09b4ef2a475aac6bfb52ad9)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:03.309367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c935e-ae83-4eba-b1c7-79f9ac6db121 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:03.311452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 191/378] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:03.316769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:03.322366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e2099-72ba-4dd9-b82e-d25ef6090d3f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.323561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e2099-72ba-4dd9-b82e-d25ef6090d3f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.323874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e2099-72ba-4dd9-b82e-d25ef6090d3f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.325923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 192/379] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:03.335194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.335495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.335781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.357484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:03.358918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:03.429562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 193/380] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:03.429868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a454c-9f7b-4156-9aed-1b611750c735 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:03.459481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:03.520120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:03.520918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.521729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.522041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] PATH_INFO: `/v3/groups/2adb34ec3b474555aa69ba0c71efe638` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.539558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] RBAC: Authorizing `identity:get_group(group_id=2adb34ec3b474555aa69ba0c71efe638)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:03.541041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:03.543124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 188/381] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/groups/2adb34ec3b474555aa69ba0c71efe638 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:03.548546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:03.568372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64bd43-6ed8-4440-a591-1cd73ab5666d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:03.607652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:03.608589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.608881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.609164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.620885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:03.628938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:51:03.631414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 194/382] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:03.637296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:03.741399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3f3ed-ec0e-4feb-a021-02bbf9ae32ee None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:03.755050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f511560-5430-42b1-ae4b-8eeb417e0a86 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:03.783256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:03.784334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.784813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.785309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.786374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] RBAC: Adding query filter params (group.id=2adb34ec3b474555aa69ba0c71efe638, role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=5c5b2c20b09b4ef2a475aac6bfb52ad9) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:03.786945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:03.788847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:03.795493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:03.795982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 189/383] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/role_assignments?group.id=2adb34ec3b474555aa69ba0c71efe638&scope.project.id=5c5b2c20b09b4ef2a475aac6bfb52ad9&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 260 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:03.796086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.796323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.796604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.797369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] RBAC: Adding query filter params (name=member) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:03.797680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:03.802004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:03.809775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 195/384] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:03.815609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:03.920418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a852b-018c-4766-b389-ff19cc0cd0fc None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:03.957450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:03.958345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:03.958628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:03.959500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:03.960712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:03.962188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:03.964200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 190/385] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:03.969735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:04.078576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63145a5-8b7c-4776-9fe5-c7227cc3b947 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:04.113606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf6e36-2844-430a-ad9f-9ffb84727a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:04.114500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6e36-2844-430a-ad9f-9ffb84727a24 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.114788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6e36-2844-430a-ad9f-9ffb84727a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.115616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf6e36-2844-430a-ad9f-9ffb84727a24 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.116829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf6e36-2844-430a-ad9f-9ffb84727a24 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:04.118345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaf6e36-2844-430a-ad9f-9ffb84727a24 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:04.120352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 196/386] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:03 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:04.125941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:04.226672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c840b-49c2-45c0-bfbc-6310971caefc None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.226997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c840b-49c2-45c0-bfbc-6310971caefc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.227233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c840b-49c2-45c0-bfbc-6310971caefc None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.229144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 197/387] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:04.231531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d604-2e9d-4d91-8081-e2130a3a4e58 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:04.234741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.235278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.235751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.255648 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:04.257652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:04.268347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:04.269244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.269525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.269798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66/groups/3a5bf5d2d5c8482bac249b704676be07/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.271883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fde128a0994d3398e451700d576d66, group_id=3a5bf5d2d5c8482bac249b704676be07, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:04.273326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:04.344197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 198/388] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:04.362766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:04.378081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 191/389] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 26 13:51:04 2022] PUT /identity/v3/projects/21fde128a0994d3398e451700d576d66/groups/3a5bf5d2d5c8482bac249b704676be07/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:04.481317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7277dbb6-140c-45fd-b43a-d03620646b19 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:04.518618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:04.519837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.520355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.520821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.533507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:04.542370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:51:04.544408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 199/390] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:04.550404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:04.695351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb068e-c4f3-4600-ab37-a26bc3f01fb6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:04.733117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:04.733801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.734123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.734398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.737995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:04.737995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:04.737995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:04.747730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 192/391] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:04.755925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:04.907157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a69940-79d7-49b1-b4f2-16fc0f1ddf39 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:04.954610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:04.956337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:04.957023 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:04.957696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:04.960404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:04.962103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:04.964286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 200/392] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:04 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:04.971998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:05.091619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae7681-37a0-42c7-9efe-03f44fe47326 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:05.125458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbe7b4-3dc0-420a-a406-3df634456dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:05.126719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe7b4-3dc0-420a-a406-3df634456dea None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.127623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe7b4-3dc0-420a-a406-3df634456dea None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.128090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbe7b4-3dc0-420a-a406-3df634456dea None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:05.129477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe7b4-3dc0-420a-a406-3df634456dea None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:05.131186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbe7b4-3dc0-420a-a406-3df634456dea None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:05.133427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 193/393] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:04 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:05.139187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:05.241163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0fc6d-de6d-4fc6-96a5-217e16125410 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:05.287643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff06a8-7192-4ad3-bc57-83760f1f5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:05.289881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff06a8-7192-4ad3-bc57-83760f1f5f87 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.290672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff06a8-7192-4ad3-bc57-83760f1f5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.291413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff06a8-7192-4ad3-bc57-83760f1f5f87 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66/groups/3a5bf5d2d5c8482bac249b704676be07/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:05.294708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff06a8-7192-4ad3-bc57-83760f1f5f87 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fde128a0994d3398e451700d576d66, group_id=3a5bf5d2d5c8482bac249b704676be07, role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:05.296454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff06a8-7192-4ad3-bc57-83760f1f5f87 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:05.403910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 201/394] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 26 13:51:05 2022] PUT /identity/v3/projects/21fde128a0994d3398e451700d576d66/groups/3a5bf5d2d5c8482bac249b704676be07/roles/2481fa0f9e714a879311d70b522a9956 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:05.659618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2b61b-ab8e-4e67-b312-b986274d55bb None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.659998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2b61b-ab8e-4e67-b312-b986274d55bb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.660191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2b61b-ab8e-4e67-b312-b986274d55bb None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:05.662454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 194/395] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:05.668073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092810e-c2c5-4da5-98d6-9ed19f8aa53e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.668374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092810e-c2c5-4da5-98d6-9ed19f8aa53e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.668658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c092810e-c2c5-4da5-98d6-9ed19f8aa53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:05.690783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c092810e-c2c5-4da5-98d6-9ed19f8aa53e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:05.692018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c092810e-c2c5-4da5-98d6-9ed19f8aa53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:05.774559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 202/396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:05.798162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2b61b-ab8e-4e67-b312-b986274d55bb None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:05.939978 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668db67-d954-400c-ab53-58f0aa1d841d None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.940271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668db67-d954-400c-ab53-58f0aa1d841d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.940455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668db67-d954-400c-ab53-58f0aa1d841d None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:05.944589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 203/397] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:05.947495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2b61b-ab8e-4e67-b312-b986274d55bb None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:05.948928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.949209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.949485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:05.975394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:05.976598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:05.997823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:05.998691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:05.998976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:05.999256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.017861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:06.025349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:51:06.038078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 195/398] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:06.066840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.075647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 204/399] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:06.108423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.207132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea17eb-6de1-4ebc-b8ea-751bd7a26bc0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.246331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.247015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.247298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.247573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.248560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:06.248669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:06.249994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:06.268215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 196/400] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:06.273827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.288128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb83c4-55b6-4de7-bb78-a20e30510ed1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.330285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.331842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.332587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.333101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.345371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:06.355886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:51:06.357680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 205/401] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:06.363114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.480056 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1ebd-42c8-4946-915f-acc5e09ce93c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.485846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8feb9-cf4f-4ea9-bca1-f1c673d363ab None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.515364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.516414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.516905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.517395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.518382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:06.518916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:06.520498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:06.530087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 206/402] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:06.535648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.535937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.536517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.537531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.538216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.542704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:06.544358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:06.546225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 197/403] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:06.551723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.640454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd1ace-64a5-49d3-ba74-b5f11efc2a84 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.676502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.677820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.678359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.678850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.680251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:06.681997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:06.683848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 207/404] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:06.689168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.758259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f5c59-e739-4569-8ca0-88ac257c9f95 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.806133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b9e04-ae27-45a9-911b-70263949fcbf None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:06.845654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.847094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.847691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.848171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.849613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:06.850715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:06.851559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:06.851683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:06.851865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:06.852310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:06.854207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 208/405] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:06.859361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.860093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:06.861764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:06.869107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 198/406] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:06 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:06.873871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:06.993284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1483cf-3d7b-47b0-b133-38219b7a8d07 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:07.033891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6c767-7e79-4b1f-b679-882422a8a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:07.035241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c767-7e79-4b1f-b679-882422a8a78e None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.037174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c767-7e79-4b1f-b679-882422a8a78e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.038024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6c767-7e79-4b1f-b679-882422a8a78e None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/groups/3a5bf5d2d5c8482bac249b704676be07/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.040578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c767-7e79-4b1f-b679-882422a8a78e None admin] RBAC: Authorizing `identity:create_grant(project_id=1f10995852ac4908a6dff0cbdef9ca55, group_id=3a5bf5d2d5c8482bac249b704676be07, role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:07.042263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6c767-7e79-4b1f-b679-882422a8a78e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:07.087069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cf9fc-c4a5-4c19-85d4-b3f2f6d89314 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:07.122496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:07.123438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.123717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.123992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/groups/3a5bf5d2d5c8482bac249b704676be07/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.126056 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] RBAC: Authorizing `identity:create_grant(project_id=1f10995852ac4908a6dff0cbdef9ca55, group_id=3a5bf5d2d5c8482bac249b704676be07, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:07.127555 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:07.150158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 199/407] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 26 13:51:06 2022] PUT /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/groups/3a5bf5d2d5c8482bac249b704676be07/roles/2481fa0f9e714a879311d70b522a9956 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:51:07.182830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051f15-763a-4ee5-8b40-20b9ca369123 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.183186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051f15-763a-4ee5-8b40-20b9ca369123 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.183388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26051f15-763a-4ee5-8b40-20b9ca369123 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.185758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 200/408] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:07.191564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.191874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.192141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.200370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 209/409] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 26 13:51:06 2022] PUT /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55/groups/3a5bf5d2d5c8482bac249b704676be07/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:07.211714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:07.213075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:07.301917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 201/410] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:07.339349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:07.451791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c8f17-b82f-43be-afde-2745db19699a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:07.488536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b10da2-a064-4542-aa1b-377dbf0ba7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:07.489328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10da2-a064-4542-aa1b-377dbf0ba7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.489609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10da2-a064-4542-aa1b-377dbf0ba7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.490558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b10da2-a064-4542-aa1b-377dbf0ba7f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.500868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b10da2-a064-4542-aa1b-377dbf0ba7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:07.507794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-02b10da2-a064-4542-aa1b-377dbf0ba7f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:07.509359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 210/411] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:07.514911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:07.588551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27a9cb-b543-442a-9121-a916e009e789 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.589005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27a9cb-b543-442a-9121-a916e009e789 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.589381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27a9cb-b543-442a-9121-a916e009e789 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.591579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 211/412] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:07.599100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.600003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.600353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.627687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:07.627687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:07.680774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213335-7622-4c81-8a4c-a7a88477c26a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:07.734085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 212/413] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:07.745462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:07.746163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.746448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.746722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.747469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:07.747772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:07.749165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:07.758260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 202/414] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:07.767043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:07.775157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:07.928376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6af05-877b-4bf7-92af-24fa5c91e511 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:07.947668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab1e3e-95e1-4dba-8a23-ac4abc82d15a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:07.969333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:07.971513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:07.971811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:07.972093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] PATH_INFO: `/v3/groups/2adb34ec3b474555aa69ba0c71efe638` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:07.976051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] RBAC: Authorizing `identity:get_group(group_id=2adb34ec3b474555aa69ba0c71efe638)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:07.978278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:07.980678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 213/415] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:07 2022] GET /identity/v3/groups/2adb34ec3b474555aa69ba0c71efe638 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:07.986335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.016443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.017754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.018062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.018347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.044559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:08.054757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:51:08.055994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 203/416] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:08.062352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.157582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f59b-a5f3-4fbb-bb1a-c09402ca9a76 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:08.201434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4af7b-c408-430f-8ab1-431292581de5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:08.221719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.222612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.222900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.223182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] PATH_INFO: `/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.225068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] RBAC: Authorizing `identity:get_project(project_id=5c5b2c20b09b4ef2a475aac6bfb52ad9)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:08.226538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:08.228246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 214/417] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:07 2022] GET /identity/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9 => generated 344 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:08.233851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.257940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.258751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.259035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.259312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.260063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:08.260366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:08.261747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:08.270365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 204/418] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:51:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:08.276577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.358570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b89e28-750e-4b7f-87e4-842c9d9c32fa None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:08.376933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab111e-cbba-4968-a2ee-6a6d0f79eb42 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:08.393240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836ac69-8325-4e6b-b916-96126c99d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.394393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ac69-8325-4e6b-b916-96126c99d2c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.394822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ac69-8325-4e6b-b916-96126c99d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.395270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ac69-8325-4e6b-b916-96126c99d2c8 None admin] PATH_INFO: `/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9/groups/2adb34ec3b474555aa69ba0c71efe638/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.398020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836ac69-8325-4e6b-b916-96126c99d2c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c5b2c20b09b4ef2a475aac6bfb52ad9, group_id=2adb34ec3b474555aa69ba0c71efe638, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:08.399602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836ac69-8325-4e6b-b916-96126c99d2c8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:08.413274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.417800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.417800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.417800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.482627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 215/419] 10.222.0.23 () {58 vars in 1442 bytes} [Tue Apr 26 13:51:08 2022] PUT /identity/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9/groups/2adb34ec3b474555aa69ba0c71efe638/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:51:08.484330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b00d-5e7a-48ee-a41f-7f6d544fdad7 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.484821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b00d-5e7a-48ee-a41f-7f6d544fdad7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.485294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b00d-5e7a-48ee-a41f-7f6d544fdad7 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.487622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 216/420] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:08.492917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.494306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.494739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.500122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:08.501962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:08.522576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:08.524616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:08.664721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 217/421] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:08.674567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 205/422] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:51:08.680974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.695702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.816026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e435591-6cc6-4527-962d-09d6c4babd7d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:08.816249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c221c-eed7-49fe-8143-c472894420f3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:08.852658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.853806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.854281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.854726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.856115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:08.857719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:08.859975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 218/423] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:08 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:08.861935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:08.862255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:08.862543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:08.862820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:08.865442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:08.880455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:08.891247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:51:08.891247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 206/424] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:08.898468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:09.056962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ce787-66c1-4866-9950-c6c54c357541 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:09.062327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b260-b2ee-4df7-8530-123b47cb32f6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:09.097825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:09.098528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.098808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.099084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.100357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:09.100661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:09.102053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:09.120180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 207/425] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:09.131217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:09.143035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:09.143900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.144189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.144465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.146747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:09.148411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:09.154076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 219/426] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:08 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:09.155806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:09.242475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a57487-0d9b-417e-9f52-86ae6b6e9c81 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:09.283515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:09.284265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.284451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.284713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.343929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d64f25-1dba-4181-9dc3-18fe975684ca None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:09.386806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:09.387400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.387693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.387973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.388820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=21fde128a0994d3398e451700d576d66) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:09.389135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:09.390621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:09.404610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 220/427] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:09 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=70a105678f91431a9d75cf7309d9a810 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:09.406885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:09.408410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:09.516353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 208/428] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:09.522503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:09.701278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f592be-03b9-411a-9772-1bd1233dc6d0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:09.728560 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:09.729700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.730164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.730693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] PATH_INFO: `/v3/projects/21fde128a0994d3398e451700d576d66` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.732048 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] RBAC: Authorizing `identity:get_project(project_id=21fde128a0994d3398e451700d576d66)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:09.733628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:09.735816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 221/429] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:09 2022] GET /identity/v3/projects/21fde128a0994d3398e451700d576d66 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:09.740936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:09.846743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dd171-3f76-4c6f-9cda-967d36353c79 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:09.881808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff89f6f-46ba-4b0c-9335-e27ee4536094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:09.882936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89f6f-46ba-4b0c-9335-e27ee4536094 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.883373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89f6f-46ba-4b0c-9335-e27ee4536094 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.883792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff89f6f-46ba-4b0c-9335-e27ee4536094 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.885152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff89f6f-46ba-4b0c-9335-e27ee4536094 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:09.886768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff89f6f-46ba-4b0c-9335-e27ee4536094 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:09.888845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 209/430] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:09 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:09.894288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:09.937271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0817aea-6621-44b9-95e4-01e45d0ee0fd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.937871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0817aea-6621-44b9-95e4-01e45d0ee0fd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.938360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0817aea-6621-44b9-95e4-01e45d0ee0fd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.940328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 210/431] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:09.951573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aa411-8c34-43bf-889b-8b7f196290b1 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:09.952182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aa411-8c34-43bf-889b-8b7f196290b1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:09.952699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410aa411-8c34-43bf-889b-8b7f196290b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:09.971301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-410aa411-8c34-43bf-889b-8b7f196290b1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:09.972831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-410aa411-8c34-43bf-889b-8b7f196290b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:10.021918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86c10c-a801-4c0c-820b-9c5ac294c9fe None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.055989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 211/432] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:10.057656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f51ac-1d3d-4fb6-9427-a648ae773482 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.058163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f51ac-1d3d-4fb6-9427-a648ae773482 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.058608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f51ac-1d3d-4fb6-9427-a648ae773482 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.060688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 212/433] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:10.060961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.061705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.065859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.065859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.065859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=21fde128a0994d3398e451700d576d66) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:10.065859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:10.065859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:10.067504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.068438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.068716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.072017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 222/434] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:09 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=21fde128a0994d3398e451700d576d66&role.id=2481fa0f9e714a879311d70b522a9956 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:10.087102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.092758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:10.094067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:10.186139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 213/435] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:10.217053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.229955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2d203-b121-4b8e-86b2-6b669593377e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.268970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.270198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.270695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.271217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.285230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:10.293450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:51:10.296841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 223/436] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:10.303436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.339844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c17e39-9458-493c-8495-8484467dfe31 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.379432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.381206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.381459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.381744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.395323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:10.404694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 26 13:51:10.406551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 214/437] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:10.414294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.451081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89799bc-772d-44c3-bb81-71b30bd6e07f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.494459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.495463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.495940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.496403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.497353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:10.497726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:10.499198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:10.513276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 224/438] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:10.518617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.543912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200a287-ce0b-4879-98d4-a719b8db140b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.588958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.589628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.589904 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.590463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.590942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:10.591242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:10.592611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:10.603958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 215/439] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:10.609236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.632556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1106e08-5291-4c00-8fe9-bbab7605f128 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.665297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.666216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.666501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.666782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.710208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5fe7e-d61a-4ffa-b8f4-c9f4eaeca9a3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.738486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:10.741621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:10.745087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.745639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.745924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.746241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.815468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:10.816929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:10.843605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 225/440] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:10.849554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.915137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 216/441] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:10.920454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:10.950432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc877c-33af-422d-9fd9-b83a1e27a6de None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:10.983843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:10.984692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:10.984976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:10.985250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:10.986719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:10.988151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:10.989868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 226/442] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:10.995158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.022762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013819-0721-470c-8720-1608ca3cad54 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.067190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.068062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.068343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.068618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] PATH_INFO: `/v3/projects/1f10995852ac4908a6dff0cbdef9ca55` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.069811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] RBAC: Authorizing `identity:get_project(project_id=1f10995852ac4908a6dff0cbdef9ca55)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.071319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:11.073166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 217/443] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/projects/1f10995852ac4908a6dff0cbdef9ca55 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:11.078233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.094346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1886f2-b5d5-4196-bbec-922de4621baa None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.127383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.128232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.128513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.128791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.129955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.131445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:11.133207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 227/444] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:10 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:11.138569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.172715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c813f3-98a1-4d24-8406-99814015c617 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.203570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454dd67-9e61-4ed2-8203-24a96b517cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.204422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454dd67-9e61-4ed2-8203-24a96b517cae None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.204704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454dd67-9e61-4ed2-8203-24a96b517cae None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.204980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454dd67-9e61-4ed2-8203-24a96b517cae None admin] PATH_INFO: `/v3/groups/3a5bf5d2d5c8482bac249b704676be07` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.206246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454dd67-9e61-4ed2-8203-24a96b517cae None admin] RBAC: Authorizing `identity:get_group(group_id=3a5bf5d2d5c8482bac249b704676be07)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.207682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454dd67-9e61-4ed2-8203-24a96b517cae None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:11.209838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 218/445] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:11 2022] GET /identity/v3/groups/3a5bf5d2d5c8482bac249b704676be07 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:11.211014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e76fe-dc38-436d-b1ab-6ba989a3dd86 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.211296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e76fe-dc38-436d-b1ab-6ba989a3dd86 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.211566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e76fe-dc38-436d-b1ab-6ba989a3dd86 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.213205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 219/446] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:11.215427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e76fe-dc38-436d-b1ab-6ba989a3dd86 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.232547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33bd44-bc75-4d5e-ad61-196c32173d15 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.264653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.265238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.265527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.265808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.266671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:11.266989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.268420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ad2fe-bc68-4d7f-baee-0e8ae9304860 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:11.274502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 228/447] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:11 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=2481fa0f9e714a879311d70b522a9956 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:11.274502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.274502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.274502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.296589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:11.297838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:11.327194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e76fe-dc38-436d-b1ab-6ba989a3dd86 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.370122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.371105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.371525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.371945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.373296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] RBAC: Adding query filter params (group.id=3a5bf5d2d5c8482bac249b704676be07, role.id=70a105678f91431a9d75cf7309d9a810, scope.project.id=1f10995852ac4908a6dff0cbdef9ca55) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:11.373775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.376162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:11.380246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 229/448] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:11.394017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 220/449] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:11 2022] GET /identity/v3/role_assignments?group.id=3a5bf5d2d5c8482bac249b704676be07&scope.project.id=1f10995852ac4908a6dff0cbdef9ca55&role.id=70a105678f91431a9d75cf7309d9a810 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:11.404188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.515803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55b33-0a62-42aa-828b-bb7cd6c982a8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.550903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.551706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.551989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.552845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.563381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:11.570287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:11.571498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 230/450] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:11.577234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.678599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7ce0c-cfd6-44b0-aa54-49fdba164fcc None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.712533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.713201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.713485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.713761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.714539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:11.714846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.716215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:11.724890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 221/451] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:11.730537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:11.828841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e28bc3-900d-42ae-aa84-e1c7e80bd06b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:11.862385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:11.863033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:11.863320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:11.863600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:11.928380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:11.929836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:12.022631 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 231/452] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:12.028251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:12.120626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54077e-0453-44a4-b121-40ecf7b41366 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:12.151983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:12.152822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:12.153102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:12.153373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] PATH_INFO: `/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:12.154567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] RBAC: Authorizing `identity:get_project(project_id=5c5b2c20b09b4ef2a475aac6bfb52ad9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:12.156001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:12.157645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 222/453] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:51:12 2022] GET /identity/v3/projects/5c5b2c20b09b4ef2a475aac6bfb52ad9 => generated 344 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:12.163148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:12.254092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149b9e6-71ac-4b34-90e4-c26660e39251 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:12.286191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55ea7c-887a-47d4-bcf8-13135e5730cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:12.287036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ea7c-887a-47d4-bcf8-13135e5730cb None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:12.287317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ea7c-887a-47d4-bcf8-13135e5730cb None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:12.287589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55ea7c-887a-47d4-bcf8-13135e5730cb None admin] PATH_INFO: `/v3/groups/2adb34ec3b474555aa69ba0c71efe638` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:12.288990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ea7c-887a-47d4-bcf8-13135e5730cb None admin] RBAC: Authorizing `identity:get_group(group_id=2adb34ec3b474555aa69ba0c71efe638)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:12.290430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e55ea7c-887a-47d4-bcf8-13135e5730cb None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:12.291986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 232/454] 10.222.0.23 () {56 vars in 1180 bytes} [Tue Apr 26 13:51:12 2022] GET /identity/v3/groups/2adb34ec3b474555aa69ba0c71efe638 => generated 229 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:12.297407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:12.389430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b07d8-9d95-4479-adaa-12144eb146ed None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:12.419944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:12.420574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:12.420857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:12.421132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:12.421952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] RBAC: Adding query filter params (group.id=2adb34ec3b474555aa69ba0c71efe638, role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=5c5b2c20b09b4ef2a475aac6bfb52ad9) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:12.422298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:12.423721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b9be6-d738-4a4a-90a7-f9fb5e08818b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:12.429730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 223/455] 10.222.0.23 () {56 vars in 1376 bytes} [Tue Apr 26 13:51:12 2022] GET /identity/v3/role_assignments?group.id=2adb34ec3b474555aa69ba0c71efe638&scope.project.id=5c5b2c20b09b4ef2a475aac6bfb52ad9&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 611 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:15.376541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f4df1-e0d3-49e9-985c-fc21c0619b02 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.377057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f4df1-e0d3-49e9-985c-fc21c0619b02 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.377167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f4df1-e0d3-49e9-985c-fc21c0619b02 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.379269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 233/456] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:15.385206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.386069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.386550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.410626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:15.412210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:15.488649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d757c-646e-4cc4-a54c-311442d6ad32 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.488649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d757c-646e-4cc4-a54c-311442d6ad32 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.488649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d757c-646e-4cc4-a54c-311442d6ad32 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.489344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 234/457] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:15.495066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf035043-77e9-4ee3-b9b0-84f9a4d883f4 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.495570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf035043-77e9-4ee3-b9b0-84f9a4d883f4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.496050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf035043-77e9-4ee3-b9b0-84f9a4d883f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.517382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-bf035043-77e9-4ee3-b9b0-84f9a4d883f4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:15.518609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bf035043-77e9-4ee3-b9b0-84f9a4d883f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:15.522136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 224/458] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:15.556209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:15.611713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 235/459] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:15.613945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236072e4-d797-48ab-9b60-9268613f7ce0 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.614510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236072e4-d797-48ab-9b60-9268613f7ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.614933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236072e4-d797-48ab-9b60-9268613f7ce0 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.617945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 236/460] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:15.623849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.624150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.624414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.648604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:15.650130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:15.681050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea4c14-b384-4b1e-ba55-4d290487afd5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:15.721424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:15.722774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.723373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.723797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.736856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 237/461] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:15.737065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:15.738717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:15.743173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:15.774105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:15.775752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 225/462] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:15.781115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:15.872352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94325fc2-fb40-4d83-badc-063e00a48b49 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:15.878929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41eaa21-ea57-4628-ad8f-065fcc44468d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:15.912657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:15.914298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.914817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.915272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:15.915549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.916064 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:15.916349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:15.916642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:15.927183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:15.928344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:15.929157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:15.929781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:15.947187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:15.948643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:15.953917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 238/464] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:15.953917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:15.954270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 226/464] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:15.955143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.056901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdfa4c-c7eb-418f-ad7e-093379a5db65 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.079745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584ce70-abc3-4ccd-9e81-c9b8d2592502 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.091510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.092172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.092458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.092733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.093457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:16.093760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.095152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.110676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 227/465] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:16.110676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.121285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.121953 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.122273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.122556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.123320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:16.123628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.125003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654144c-bde5-4b9e-ace4-bf68d861bee9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.137403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 239/466] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:16.138702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24491a-91a0-49e0-ad53-35099202c561 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.138996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24491a-91a0-49e0-ad53-35099202c561 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.139278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24491a-91a0-49e0-ad53-35099202c561 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.140904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 240/467] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:16.141836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24491a-91a0-49e0-ad53-35099202c561 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.214970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400619-dfba-441a-8674-4f37738eb441 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.240651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24491a-91a0-49e0-ad53-35099202c561 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.248844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.249837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.250246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.250527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.251312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:16.251598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.252972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.265334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 228/468] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:16.266172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.278707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c129d-3bb2-461b-8781-5745a1d188bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.279377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c129d-3bb2-461b-8781-5745a1d188bb None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.279659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c129d-3bb2-461b-8781-5745a1d188bb None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.279943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c129d-3bb2-461b-8781-5745a1d188bb None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.280647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c129d-3bb2-461b-8781-5745a1d188bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.282107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c129d-3bb2-461b-8781-5745a1d188bb None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.361210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d999e71e-a6c4-4807-b00f-7e77936d538a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.394137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.394797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.395078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.395352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.396073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.397497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.405898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 241/469] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:51:16 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:16.407645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a210e-12d0-4976-8d5f-6d3d273d406f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.407936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a210e-12d0-4976-8d5f-6d3d273d406f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.408216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a210e-12d0-4976-8d5f-6d3d273d406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.425892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9b7a210e-12d0-4976-8d5f-6d3d273d406f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:16.427659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9b7a210e-12d0-4976-8d5f-6d3d273d406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:16.488357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 229/470] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:51:16 2022] POST /identity/v3/users => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:16.496465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.500030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 242/471] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:16.501205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784b60-1338-4904-8234-e9b91dbfec6b None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.501502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784b60-1338-4904-8234-e9b91dbfec6b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.501784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28784b60-1338-4904-8234-e9b91dbfec6b None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.505194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 243/472] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:16.511012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.511276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.511542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.532323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:16.533775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:16.619409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 244/473] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:16.620323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.628451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df45fc-4daa-4fa7-b07a-94451d6ef09a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.675470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.676569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.677064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.677520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.679141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.680835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.740479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e06c7-a2ba-4bf2-9d26-0bd8b0eca392 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.776172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.776965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.777250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.777526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.789136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.790797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:16.808038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:16.809440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 245/474] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:16.810017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.831192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 230/475] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:51:16 2022] POST /identity/v3/users => generated 248 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:16.832305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:16.934522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692e395-d801-415a-a4f6-a318afb05261 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:16.972814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:16.973602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:16.973863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:16.974145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:16.974941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:16.981992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:17.014250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.sql.core [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 26 13:51:17.014250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 26 13:51:17.014250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [parameters: {'id': '40d94f37b7ae4773a077391d63aee7e0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 26 13:51:17.014250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80041) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 26 13:51:17.039990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 26 13:51:17.045100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 246/476] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 26 13:51:16 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:17.049935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:17.064902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac695db6-efc4-499b-af76-a569055a5511 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:17.131226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:17.131897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:17.132177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:17.132450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:17.133171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:17.133475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:17.135031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:17.154005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 231/477] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:17.157895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:17.204704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad57f7e-610c-4d5c-aecd-576e2725497e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:17.244979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:17.246180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:17.246660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:17.247128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:17.260347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:17.270031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 26 13:51:17.272701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 247/478] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:17.278340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:17.284988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fe73-1d33-4a4a-b9c3-165f6fedd1a5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:17.328750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a643db1-1748-4386-bb29-820794cae0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:17.329747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643db1-1748-4386-bb29-820794cae0a5 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:17.330059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643db1-1748-4386-bb29-820794cae0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:17.330340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643db1-1748-4386-bb29-820794cae0a5 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:17.331048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a643db1-1748-4386-bb29-820794cae0a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:17.332944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a643db1-1748-4386-bb29-820794cae0a5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:17.386536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fc255-3df0-4590-add8-4a489c836462 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:17.426167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:17.426949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:17.427243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:17.427521 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:17.429845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 232/479] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:51:17 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:51:17.430272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:17.430376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:17.432131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a78743-c8da-400f-bcbd-a525779524f8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:17.445205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 248/480] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:19.380952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad558c7-8322-4a8c-a8dc-e02009762016 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.381467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad558c7-8322-4a8c-a8dc-e02009762016 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.381574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad558c7-8322-4a8c-a8dc-e02009762016 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.383593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 233/481] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:19.388400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.388789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.388983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.410796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:19.412596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:19.498871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba93ee-1d0b-4c2e-b3ea-cf394dad47d9 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.499499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba93ee-1d0b-4c2e-b3ea-cf394dad47d9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.499971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba93ee-1d0b-4c2e-b3ea-cf394dad47d9 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.506359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 234/482] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:19.507699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.508176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.508643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.511514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 249/483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:19.534641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:19.541369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:19.542715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:19.633847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba112a-96b3-4d96-b025-e72000f4d580 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:19.672535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:19.673608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.674821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.675246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.695298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:19.702818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:19.710094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 235/484] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:19.713993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 250/485] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:19.727167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:19.742847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:19.899078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e50703-b9ce-4d32-8274-1496937f66ad None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:19.902702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fee7e-8c74-41dc-98e8-c10dbeab447b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:19.934432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:19.935340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.935768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.936188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.937091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:19.937537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:19.937814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8490827-c1c6-4d94-9973-20453d987474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:19.938730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8490827-c1c6-4d94-9973-20453d987474 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.939110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8490827-c1c6-4d94-9973-20453d987474 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.939480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8490827-c1c6-4d94-9973-20453d987474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.939744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6ad6-0df7-49e0-a090-f6e6c049e3cb None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:19.953709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8490827-c1c6-4d94-9973-20453d987474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:19.953960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 236/486] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:19.955580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4223-cd7e-42a5-a198-d6663256d9d0 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.956041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4223-cd7e-42a5-a198-d6663256d9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.956475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4223-cd7e-42a5-a198-d6663256d9d0 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.958783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 237/487] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:19.965701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4223-cd7e-42a5-a198-d6663256d9d0 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:19.965838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c8490827-c1c6-4d94-9973-20453d987474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:19.965838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 251/488] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:19.967718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:19.968396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:19.968860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:19.987869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:19.990019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:20.066257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 252/489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:20.070202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.099727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4223-cd7e-42a5-a198-d6663256d9d0 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.139567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.140369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.140651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.140927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.151840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.153229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.169675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4da19b-847b-4d23-9eb5-137bc0e1c47a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.169828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:20.171014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 238/490] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:20.171870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.208757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.209429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.209761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.210072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.210834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:20.211148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.212593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.220975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 253/491] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:20.226694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.292536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c84117-a9e5-42dd-9700-45eb2f956000 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.327857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe2cf3-be78-4260-807f-ac757ae44d31 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.337292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.338185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.338782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.339064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.352626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:20.361808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:20.363206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 239/492] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:20.365836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.368182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.369093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.369599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.370120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.371052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:20.371559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.373146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bb5d2-4251-48db-b7b0-07449490bc51 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.391318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 254/493] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:20.393419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e21ce-6899-4fa2-b6ec-deb2c5d6ea39 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.393940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e21ce-6899-4fa2-b6ec-deb2c5d6ea39 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.394461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e21ce-6899-4fa2-b6ec-deb2c5d6ea39 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.396413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 255/494] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:20.397358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e21ce-6899-4fa2-b6ec-deb2c5d6ea39 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.473462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c280ac-a1e1-481c-ad94-dbf0c934078e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.494185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e21ce-6899-4fa2-b6ec-deb2c5d6ea39 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.505018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.505805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.506126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.506400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.516252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.517696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.525721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.526406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.526689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.526966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.527716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:20.528025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.529377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cd619-687a-4c34-8781-427f91cb55ea None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.533301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:20.534499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 240/495] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:20.535259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.541950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 256/496] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:20.541950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f3ec-bb08-4448-8370-7d1d2c166e9a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.541950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f3ec-bb08-4448-8370-7d1d2c166e9a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.541950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f3ec-bb08-4448-8370-7d1d2c166e9a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.541950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 257/497] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:20.542384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.542470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.542801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.559211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:20.560417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:20.622223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 258/498] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:20.623026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.645408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eeaf8-86d1-4d49-b7e5-1a31a85aa2cd None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.677924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.678810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.679094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.679367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.686981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.688467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.702157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 26 13:51:20.703281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 241/499] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:20.704042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.728566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb7ede-8b07-445b-be89-297b6b1e5978 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.759723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.760373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.760656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.760929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.761645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:20.761954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.763331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f04865-f259-4131-848a-8e0fcb0ccbd9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.774456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 259/500] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:20.775630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.775919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.776192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.793303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:20.794515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:20.799722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b3b6a-bf55-485c-9ce9-7bf5a67ddadb None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.830952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.831736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.832014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.832287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.842797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.844240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.856262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 260/501] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:20.857068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.860588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:20.866296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 242/502] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:20.866296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:20.948981 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0558aa-9890-434a-8411-c0589b6b72cd None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.959326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e427f8-bf80-46a4-a5e6-16f4d451c0c9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:20.981579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.982398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.982683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.982961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.990261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:20.990902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:20.991177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:20.991442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:20.992254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:20.992552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:20.992651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:20.993962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:20.999554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:21.000736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 261/503] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:21.001498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.030677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 243/504] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 26 13:51:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:21.031508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.100954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058010b-880a-4db6-bfd3-4f1329451477 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.121940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32af4b-f845-4cd3-ad73-55cb48587686 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.132877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.133660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.133948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.134252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.141010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.142491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.153869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.154543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.154823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.155095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.155807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:21.156109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.156596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:51:21.157471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.157765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 262/505] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:21.158642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.172915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 244/506] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:21.172915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.254392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d16b23-e43a-42e5-924b-78c701da5620 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.263637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752df81d-f0bb-4bf2-b74b-41e54d5f2b23 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.286387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.287164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.287450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.287988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.295141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.295789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.296067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.296339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.297064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:21.297365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.298268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.298761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.299703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.306251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 245/507] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:21.307008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.315638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:21.316831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 263/508] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:21.318207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.398663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d794c-abea-4127-b242-ae154b46d7d8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.410369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d02d18-ab1f-4de5-8af0-8ef173855205 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.429633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.430289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.430571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.430846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.444086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.444755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.445041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.445319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.446186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:21.446501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.447935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.483278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 264/509] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:21.484079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.493746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.495249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.577298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21951911-f614-48ee-9c1b-62432d38a28b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.585510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 246/510] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:21.586353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.614752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.615549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.615835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.616110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.622876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.624310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.637912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 26 13:51:21.639080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 265/511] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:21.639833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.684027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1ee6d-b67a-406f-a90e-604ace863a98 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.716531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.717307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.717583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.717848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.729000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.730497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.732942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548de007-4201-47f4-8b96-b4010d31649b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.747092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:21.748418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 247/512] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:21.749105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.769498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.770233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.770540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.770842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.771561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:21.771868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.773221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.784256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 266/513] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:21.785026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:21.842950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed38e9-7341-49df-9733-56efeaba4edc None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.873323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.873983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.874294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.874573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.877288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f48b75-5074-4592-9090-799f5d2f07a8 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:21.909553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:21.910347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:21.910635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:21.910911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:21.920704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.922180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.936474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:21.937901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:21.938173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:21.939481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 267/514] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:21.940173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.033233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b3970-8429-48cf-87f9-c19cff450cd5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.033774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 248/515] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:22.034639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.065547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.066240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.066586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.066880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.068229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:22.068540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.069986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.087046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 268/516] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 26 13:51:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:22.087672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.126852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30366d02-92b1-4992-bb6f-fee4fce6520d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.158533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.159179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.159457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.159727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.160434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:22.160730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.162993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.173408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 249/517] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:22.174190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.183312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6548b8-33cc-4ad1-ab49-a6dd2ed6280a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.215007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.215655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.215936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.216219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.216905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.218349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.265852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ad4b5-5fc5-469e-9009-b23bd43b162d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.297978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.298634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.298913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.299185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.299891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:22.300187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.301543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.312476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 250/518] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:22.313271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.368202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 269/519] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:51:22 2022] POST /identity/v3/users => generated 247 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:22.369023 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.414447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0859526-b301-4d4d-99bd-027dd6decb3e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.452278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.453100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.453381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.453651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.465627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.467185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.479623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a798-5868-401d-a37f-5116a3d69789 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.485710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:22.486998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 251/520] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:22.487802 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.516179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.517292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.517797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.518118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.593945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a8e3e-4bd4-48ad-8743-8caecb8e5450 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.596209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.597676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.628763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.629565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.630393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.630683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.637593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.639083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.653362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 26 13:51:22.654567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 252/521] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:22.655330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.704718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 270/522] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:22.705774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.754319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35f79a-1a43-4d0e-9ce9-f6932dff1360 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.792040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.792841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.793125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.793401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.800082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.801579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.804012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffd077-5c1e-49a3-8409-d60aa3b75ed0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.818199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:22.826202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 253/523] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:22.826202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.846789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.847609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.848208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.848492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.849498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:22.849979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.851969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.864839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 271/524] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:22.869994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.918502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614894-b9c4-403a-bf4c-c26828d79bc0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.950831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.951715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.952174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.952677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:22.953688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:22.954265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:22.955945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:22.965768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d413b-fe24-4abc-a7bf-e47a6676cf1b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:22.972558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 254/525] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:22.973573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:22.998018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:22.998799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:22.999081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:22.999356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.009952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.011413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.026946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:23.028379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 272/526] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:23.029865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.074724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3969a6-06fd-441d-93e4-df90137460a0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.107674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.108327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.108610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.108889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.109672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:23.110006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.111467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.129168 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 255/527] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:23.129794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.134778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5f7f6-f71c-4a97-8aae-2666236095dc None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.166575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.167642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.168103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.168591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.175561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.177609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.190877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:23.192422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 273/528] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:23.193701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.229737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98ce8a-3538-4d77-9dad-ab018b135035 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.262464 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.263097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.263375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.263646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.292923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b74504-87b6-498b-860a-45ff85a41992 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.327788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.328641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.329065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.329422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.329733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.330624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:23.330916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.331231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.332716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.344223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 274/529] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:23.345229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.424533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 256/530] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:23.425672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.445993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c24e-8dd4-45fa-ad3a-fe458d951401 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.478608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.479254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.479537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.479856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.480634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=2132fa7fbd034deb938e9032ec710d7a) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:23.480941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.482404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.498143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 275/531] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/role_assignments?user.id=2132fa7fbd034deb938e9032ec710d7a&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:23.498143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.529606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4259-2d65-41e4-82cf-ce247475a58d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.566326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.566996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.567278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.567609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.568440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:23.568714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.570247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.587730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 257/532] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:23.588716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.608586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ae1579-14b4-43b9-8044-b73e8ab12c27 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.655871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.656675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.656955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.657257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.669246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.671576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.690693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:23.691946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 276/533] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:23.695727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.711479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fbbd6-d5c9-4b67-90af-cb1f9c48d4c9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.752476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.753835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.754370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.755092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.772000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.774266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.794336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:23.796143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 258/534] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:23.797190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.797365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2871baa-c660-46dc-bc2e-0d3d8e6d6546 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:23.830836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:23.831494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:23.831780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:23.832054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:23.832886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=8b647906359a4d8bb2e0cf3098d62967) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:23.833729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:23.835236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:23.848167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 277/535] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/role_assignments?user.id=8b647906359a4d8bb2e0cf3098d62967&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:23.848167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:23.964174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97cdbc-7d5a-4443-8b01-8e156298a1b3 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:24.000408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:24.001074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.001355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.001630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.002386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:24.002745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:24.004074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:24.016979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 278/536] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:24.018937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233baec-07c6-42af-b759-1e7feea2b1f2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:24.026746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:24.076124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:24.077029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.077384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.077731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.078945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:24.079571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:24.081272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:24.096922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 259/537] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:24.104285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:24.182601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f670ce-1911-4dbf-978a-60eba6432baf None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:24.234662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:24.235452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.235732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.236005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.251305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:24.252815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:24.276563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:24.277788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 279/538] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:24.285481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:24.291373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4414f-d506-43c8-847c-dd60e4f3da94 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:24.348013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:24.348776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.349060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.349334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.350373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=57a82877b3b14091b942181b4887edff) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:24.350683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:24.352121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:24.358532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 260/539] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:24 2022] GET /identity/v3/role_assignments?user.id=57a82877b3b14091b942181b4887edff&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:24.450806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce7508-59a9-427d-a18a-219fe81cfd4e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:24.494568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:24.495322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.495528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.495811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.496618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:24.496932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:24.498433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ece45-544a-4b1c-86cf-fa2eda234ef7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:24.519286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 280/540] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:24.525051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:24.650392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f065f99-f1bc-4df5-a714-470f25c86831 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:24.684534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:24.685183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.685594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.685869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.686724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=7b30d840c80a46799c0ac7d70daf0e5d) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:24.687028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:24.688461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547def1d-205d-492b-b1f1-d80ec6142c36 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:24.698481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 261/541] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:24 2022] GET /identity/v3/role_assignments?user.id=7b30d840c80a46799c0ac7d70daf0e5d&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:24.760626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a63f-eaad-4fb2-83c6-49091c4c7dc1 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.760946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a63f-eaad-4fb2-83c6-49091c4c7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.761217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1a63f-eaad-4fb2-83c6-49091c4c7dc1 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.763303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 281/542] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:24.769015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:24.769573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:24.769573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:24.787264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:24.788741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:24.871907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 262/543] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:24.920702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a63f-eaad-4fb2-83c6-49091c4c7dc1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:25.042079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1a63f-eaad-4fb2-83c6-49091c4c7dc1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:25.078537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:25.079346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:25.079630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:25.079906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:25.091419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:25.098409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:25.100007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 282/544] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:25.105743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:25.209846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe97ca1-18f3-4a62-a7dd-2ebb3f827e8f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:25.243523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:25.244206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:25.244489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:25.244766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:25.245536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:25.245843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:25.247318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:25.257573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 263/545] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:25.263166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:25.367062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610b4fb-d169-4926-b673-f4a6b81ea88d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:25.402028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:25.402837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:25.403121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:25.403401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:25.414438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:25.415892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:25.433516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:25.448068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 283/546] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:25.448946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:25.571281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04334cce-771b-4b6f-91c4-a061c7f769b7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:25.609454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:25.610147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:25.610432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:25.610708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:25.611435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:25.611743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:25.613122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:25.625719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 264/547] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:25.632897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:25.763330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedfa7a-30f4-4580-8ae4-22d8ea5be9a6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:25.822441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:25.823518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:25.823941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:25.824355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:25.833883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:25.835374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:25.855793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 26 13:51:25.857458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 284/548] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:25.863059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:25.979218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f13aa-58aa-4fb1-8d1e-961dd88348db None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:26.017028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:26.017710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.018020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.018298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.019139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:26.019448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:26.021433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c8b27-9328-4662-b4cc-aaabf60bea2e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:26.040169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 265/549] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 26 13:51:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:26.047039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:26.233691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2211-3cfe-4881-90e0-8e8991129a14 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:26.274688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:26.275344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.275625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.275900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.327936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8207-e695-438b-9a05-274985963d25 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.327936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8207-e695-438b-9a05-274985963d25 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.327936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8207-e695-438b-9a05-274985963d25 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.328785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 266/550] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:26.334608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.335139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.335618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.358275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:26.361720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:26.385272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:26.387152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:26.477505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 267/551] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:26.503358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:26.582062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 285/552] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:26.587822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:26.606217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68359e8d-15e3-47da-ada4-c2b336de2dba None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:26.640591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:26.641748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.642273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.642747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.653037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:26.660193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:26.661952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 268/553] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:26.668009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:26.686883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329a2c2-dc1e-4326-a86c-e65142711e19 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:26.724681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:26.725550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.725761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.726070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.736502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:26.738008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:26.756954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:26.758471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 286/554] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:26.766096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:26.810701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05fb45-f1ec-4c33-8082-055d7d788570 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:26.875053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:26.876152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.876581 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.876993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.878325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:26.878749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:26.881364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:26.901088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 269/555] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:26.906676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:26.915171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459d52e-640c-4d5e-8e9b-52f5b2120891 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:26.954511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:26.955179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.955471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.955757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.956486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:26.956794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:26.958224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455e183-d7c3-421c-a868-9ba812cb7a13 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:26.970127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 287/556] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:26.971536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3a1f-3594-4135-a6a8-ba35903f8d10 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:26.971833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3a1f-3594-4135-a6a8-ba35903f8d10 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:26.972119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b3a1f-3594-4135-a6a8-ba35903f8d10 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:26.978038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 288/557] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:26.978038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3a1f-3594-4135-a6a8-ba35903f8d10 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.026739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b46a1-3370-480c-a92c-a0fde8815064 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.062912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.064246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.064679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.065125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.079175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.079405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b3a1f-3594-4135-a6a8-ba35903f8d10 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.081148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.102592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c86adf82-2132-4bec-9d01-20543c3fbd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:27.105035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 270/558] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:27.106646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.107433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.108124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.116479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.116674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.116897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.117177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.124331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.125781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.129169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:27.130602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:27.139274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:27.146522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 289/559] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:27.146522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.226886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 271/560] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:27.228080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.255479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223acaf-ba42-4ec6-86b8-a82281f068f4 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.290166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.290755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.291128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.291419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.292151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:27.292460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.293830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.306653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 290/561] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:27.310970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.343084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba197a-a122-4f2b-b3aa-04fbe408140c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.378686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.379350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.379675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.379955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.380742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:27.381051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.382526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7846-4c47-483d-bde9-8ae44c022e42 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.393924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 272/562] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:27.395191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04e65-26d5-413e-8cfb-8774635c1978 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.396046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04e65-26d5-413e-8cfb-8774635c1978 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.396326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f04e65-26d5-413e-8cfb-8774635c1978 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.402181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 273/563] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:27.402181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f04e65-26d5-413e-8cfb-8774635c1978 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.421298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9420f-2855-4ed3-985a-4aa9caafc448 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.454370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.455238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.455530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.455807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.466406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:27.473359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:27.476149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 291/564] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:27.476800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.507533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f04e65-26d5-413e-8cfb-8774635c1978 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.541064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.541812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.542131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.542408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.549851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.551353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.564488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-cce19a7e-5e4d-42b5-a84d-b246c93cf2cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 26 13:51:27.570294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 274/565] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:27.570294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.570294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.570294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.575195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69bc45-b467-4215-86dc-b207d076c7ed None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.585723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:27.586945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:27.608488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.609232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.609524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.609813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.610689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=e24a392a4a96416bb50306d6443036ca) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:27.611007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.612455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.617947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 292/566] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/role_assignments?user.id=e24a392a4a96416bb50306d6443036ca&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:27.618577 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.664211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 275/567] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:27.665576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.729671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b0209-9a88-40ab-85a7-f2cec34754b9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.764841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.765519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.765812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.766127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.766905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:27.767281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.768688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.782743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 293/568] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:27.784058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead50ba5-80e6-4787-a9a4-d4b68c490a1a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.784219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.821000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.821931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.822402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.822837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.823671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:27.823979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.825426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739519d-48ac-4ef0-a62a-d1e9638a18a1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:27.844495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 276/569] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:27.845888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3391a7-0988-430d-8690-9a7aa46216ff None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.846244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3391a7-0988-430d-8690-9a7aa46216ff None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.846522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3391a7-0988-430d-8690-9a7aa46216ff None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.850234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 277/570] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:27.851097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3391a7-0988-430d-8690-9a7aa46216ff None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.895951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57596927-2fd4-4b4c-95f3-5235e055f950 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.929301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.930130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.930414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.930695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.940340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:27.947827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:27.948669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3391a7-0988-430d-8690-9a7aa46216ff None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:27.953771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 294/571] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:27.953771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:27.986630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:27.987491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:27.987776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:27.988051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:27.998367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:27.999827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.016769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-490c4db1-d257-48ec-bc2c-a3094a29888a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:28.023163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 278/572] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:28.023163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.023163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.023163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.038466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:28.039670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:28.049204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ab59-9938-476c-8806-1100f89fb714 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.081301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.082040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.082326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.082605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.093171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.094653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.104157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 279/573] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:28.105264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.110220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:28.116321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 295/574] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:28.117138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.212197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb71c8-5896-4b3c-b179-714179da453a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.215934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fc207-5646-4663-949b-4bc190dc5e74 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.245912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.246899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.247414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.247868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.248712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.248964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:28.249366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.249623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.249720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.249919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.250671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:28.250982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.251796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.252341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.260704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 280/575] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:28.261690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.268964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 296/576] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:28.270456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.356395 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e4670-0a84-4d17-b7e3-747df17415be None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.369636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4805-4615-406e-ac29-7ae5ca3cc432 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.392698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.393572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.394059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.394335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.395042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:28.395452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.396810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.403022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.403814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.404098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.404377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.412573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 281/577] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:28.412573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.419113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:28.426001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:28.428036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 297/578] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:28.428815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.513063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccadef6-fa31-4502-a2ac-0060de8d877f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.530376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a6e2-dc8f-4cc8-af95-28284f8f625c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.548252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.549047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.549331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.549605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.559996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.561536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.563925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.564516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.564801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.565081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.572525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.573956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.577824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:28.583745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 282/579] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:28.583745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.587330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:51:28.592686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 298/580] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:28.592686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.678658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038e34b-a532-4c9e-acd5-a8c16b21541b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.689601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10c00f-4181-4691-bc83-0bcdd9ef2dc9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.711085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.711885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.712169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.712441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.719010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.720460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.722659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.723827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.724217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.724496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.725247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:28.725551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.726979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.734212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:28.734966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 299/581] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:28.735604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.745109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 283/582] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:28.745109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.834062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c92e2-d9e2-415a-b483-bbe4c9d056a0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.842211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7607984-f931-40f3-83db-736c4437e9b1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.867011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.867944 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.868491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.868833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.869626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:28.870032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.871404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.874843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:28.875508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:28.875786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:28.876108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:28.876934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:28.877237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:28.878662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:28.887178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 300/583] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:28.887178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.898587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 284/584] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:28.899697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:28.978155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421037c-df99-4b5a-ae2d-975dfed3b156 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:28.993104 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8df17-28d2-4d61-93c3-1965d6aed8e1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.009182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.009954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.010262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.010537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.020025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.022063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.025418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.026094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.026379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.026654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.027431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:29.027742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.029155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.039964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:29.046051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 285/585] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:29.046201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 301/586] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:29.046201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.046739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.140566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0db6cb-452e-4189-8e96-9b449f710905 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.146634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb3bc-57cf-4cac-9a5e-73d0bad9768a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.174851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.175633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.175925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.176204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.180719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.181754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.182277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.182781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.186226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.187670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.191173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.192663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.204141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:29.210542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 302/587] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:29.210542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.210738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 26 13:51:29.210738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 286/588] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:29.210738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.305528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75203d5-54b5-468a-90ff-8a776e96866a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.307030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376f567-5608-42b5-a83f-27d464a9c86f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.341763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.341950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.342691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.342976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.343195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.343309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/2132fa7fbd034deb938e9032ec710d7a/roles/9317c68e1e944d86b668333be048d093` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.343721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.344199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.345218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:29.345663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.347275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.357432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=2132fa7fbd034deb938e9032ec710d7a, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.358897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.359799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 287/589] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:29.360758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.448366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 303/590] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:29 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/2132fa7fbd034deb938e9032ec710d7a/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:29.457365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.457559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e6437-1274-44eb-a625-644d05ed272d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.501958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.503006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.503471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.503948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.505031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:29.505542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.507242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.520237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 288/591] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:29.521544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.580790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487189f-9589-47e4-83f1-e918c894a963 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.619050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.619849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.620202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.620549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.621916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:29.621916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.623495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.634583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca124aa-ed5e-45e5-b1ac-770661f0a37b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.644440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 304/592] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:29.644440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.672959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.673767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.674079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.674356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.682442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.683893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.697686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 26 13:51:29.703442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 289/593] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:29.703442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.753561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24787538-b595-46bd-8d59-e24ea91c41b5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.789435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.790009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.790401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.790777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.798037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.799670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.812958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:29.814569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 305/594] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:29.815483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.821477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf14dc0-fe24-4561-9e50-12a9d2fd1fa8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.856231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.857345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.857824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.858295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.869277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.870997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.887587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:29.893495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 290/595] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:29.894646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:29.919155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66301d-dd9f-4aaf-b12c-b21cebcb2ca9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:29.952039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:29.952708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:29.952995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:29.953273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:29.954135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:29.954451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:29.955875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:29.977922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 306/596] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:29.977922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.000791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f38a1-59df-47b5-bc8d-85ee58c0023d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.037431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.038568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.039016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.039443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.040360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:30.040817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.042441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3a71b-b943-4680-9b06-37a36cc17652 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.054179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 291/597] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:30.055546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983636-efc3-4a9a-a0ee-6ccd95edc5fb None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.055902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983636-efc3-4a9a-a0ee-6ccd95edc5fb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.056247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c983636-efc3-4a9a-a0ee-6ccd95edc5fb None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.058152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 292/598] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:30.062662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983636-efc3-4a9a-a0ee-6ccd95edc5fb None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.079027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1912f8-a981-473f-b3c7-64360547528e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.112187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.112777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.113076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.113352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.114113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:30.114424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.115859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.126666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 307/599] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:30.127437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.167490 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c983636-efc3-4a9a-a0ee-6ccd95edc5fb None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.204769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.205565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.205849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.206157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.216282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.217726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.231520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ef43a-58cc-4210-9417-35f74ca85bb0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.234585 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-097a0c0c-860c-4dbf-8b24-32d6b136a1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:30.240191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 293/600] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:30.240191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.240191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.240191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.253748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:30.255499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:30.268261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.269344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.269774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.270806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/8b647906359a4d8bb2e0cf3098d62967/roles/9317c68e1e944d86b668333be048d093` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.287637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=8b647906359a4d8bb2e0cf3098d62967, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.289610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.318919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 294/601] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:30.319558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.383950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 308/602] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:30 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/8b647906359a4d8bb2e0cf3098d62967/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:30.395024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.426026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc48590-b8f9-4c05-a9e9-d44543de7cdd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.472012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.472833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.473119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.473438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.481208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.482722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.497515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:30.498973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 295/603] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:30.504426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.523161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a2a6b-80f6-4666-a92c-8e836abe7076 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.560330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.560997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.561281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.561559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.562330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:30.562639 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.564037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.577446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 309/604] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:30.582402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.611959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efd269-a1e4-4f0e-83be-94c3247ccb56 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.649533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.650518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.650903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.651283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.661938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:30.669573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:30.671191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 296/605] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:30.672227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.687522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157700-b481-41ad-9f71-283218fb4734 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.722232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.722943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.723234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.724092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.724889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:30.725200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.726730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.740587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 310/606] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:30.741477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.779627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6feb0-254c-4902-a7e6-949360e43b11 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.813738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.814576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.814860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.815139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.822418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.823867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.837834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:30.839217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 297/607] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:30.839880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.846139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebaa0-8673-489b-86de-e170a6ae9a43 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.881415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.882111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.882403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.882685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.883440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:30.883751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.885179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.893898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 311/608] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:30.894829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:30.938907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d051f-d6eb-4675-af20-d27c24fe659d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:30.973059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:30.973993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:30.974290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:30.974566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/57a82877b3b14091b942181b4887edff/roles/9317c68e1e944d86b668333be048d093` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:30.988688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=57a82877b3b14091b942181b4887edff, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:30.990200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:30.997103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b123373-367e-4030-b4b2-26cc0f875c9f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.030434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:31.031091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.031380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.031724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.032506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:31.032869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:31.034427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:31.046792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 312/609] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:31.047396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:31.094801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 298/610] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:30 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/57a82877b3b14091b942181b4887edff/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:31.096579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:31.224559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f9c4-5962-4cf3-af87-6a799bcd16ce None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.281772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:31.282988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.283489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.284002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.295689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:31.297672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:31.299736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3fb03f-b523-4bd3-aca1-f497221a81be None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.317633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:31.319570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 313/611] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:31.325095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:31.336941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:31.338123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.338123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.338424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/7b30d840c80a46799c0ac7d70daf0e5d/roles/9317c68e1e944d86b668333be048d093` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.353420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=7b30d840c80a46799c0ac7d70daf0e5d, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:31.354910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:31.445608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0389b9f-30dc-400c-b2b1-1554f8dc9682 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.455606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 299/612] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:31 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/7b30d840c80a46799c0ac7d70daf0e5d/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:31.494339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:31.494938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.495229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.495600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.496362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:31.496727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:31.498221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:31.512409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 314/613] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:31.517586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:31.625834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751470c2-d3b1-44ba-9d01-ba6b13ea2d92 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.661822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:31.662928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.663219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.663493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.671689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:31.673203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:31.688056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9739d5b1-c0b2-4789-927d-9ceac593dbfb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 26 13:51:31.689587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 300/614] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:31.696815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:31.805628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67983-34b5-4ac4-96f2-119d9d47f813 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.846286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:31.847024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.847251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.847528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.848912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:31.849225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:31.850683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:31.868577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0a0e-0455-4016-ab1c-b54492771306 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.868916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0a0e-0455-4016-ab1c-b54492771306 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.869199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0a0e-0455-4016-ab1c-b54492771306 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.871531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 301/615] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:31.873512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 315/616] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 26 13:51:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:31.878707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:31.879084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:31.879501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:31.880278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:31.904103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:31.905760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:31.984322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f53df-d883-4c23-99c0-492e8335f9c3 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:31.991470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 302/617] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:32.015376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.025194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.026335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.026891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.027387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.038584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.040293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.057823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:32.059627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 316/618] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:32.065242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.130709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8223118-3909-4b06-b240-b87c7a288464 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.177260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccd755-dc07-4851-945e-46c38a59d8b9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.215969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.216779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.217064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.217342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.220649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.221484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.221775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.222079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.222813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:32.223123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.225052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.241875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:32.257166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:32.259598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 317/619] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:32.259853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 303/620] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:32.266395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.269817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.401647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489050a3-c623-4643-8c05-67cbfa9e7ca9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.425030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8a1e9-ec7b-4e0f-bac8-35799a726da8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.444823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.445514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.445801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.446107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.446886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:32.447201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.448599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.466430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 318/621] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:32.472479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.485334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.486465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.486966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.487456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.498381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.501497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.525198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:32.527079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 304/622] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:32.532238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.616957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9775e-a6e6-47e7-bff6-db81aa40264d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.653052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.654199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.654721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.655209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.666852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.668647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.686327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:32.688035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 319/623] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:32.699389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.716151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae81b3-d8a0-4cd8-a8f0-24f17a1e70d1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.770680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.771613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.772351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.772351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.773160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:32.773473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.775102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.787196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 305/624] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:32.793119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.810883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c0c0-a377-474a-9c2f-819706b79363 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.845049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.846065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.846551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.847454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.848398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:32.848915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.850509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:32.867579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 320/625] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:32.869140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:32.932425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b766-564f-44a1-9e06-e15749ee003d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:32.967939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f22af5-0067-4574-a922-ddd8acd0821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:32.969443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f22af5-0067-4574-a922-ddd8acd0821e None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:32.969443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f22af5-0067-4574-a922-ddd8acd0821e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:32.969443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f22af5-0067-4574-a922-ddd8acd0821e None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/e24a392a4a96416bb50306d6443036ca/roles/9317c68e1e944d86b668333be048d093` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:32.984698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f22af5-0067-4574-a922-ddd8acd0821e None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=e24a392a4a96416bb50306d6443036ca, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:32.986206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f22af5-0067-4574-a922-ddd8acd0821e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:33.006827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a13ea-3a97-4653-a4d5-6b9a7c63b898 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:33.040451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:33.041297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.041597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.041874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.049932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:33.052289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:33.056275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 306/626] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:32 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/e24a392a4a96416bb50306d6443036ca/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:51:33.064225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55ec5-7701-4eb9-a0ef-7a57b22fa6bd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.064836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55ec5-7701-4eb9-a0ef-7a57b22fa6bd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.065311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee55ec5-7701-4eb9-a0ef-7a57b22fa6bd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.067751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 307/627] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:33.070319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 26 13:51:33.073082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.073610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.074115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.078019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 321/628] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:33.078019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.114836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:33.116081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:33.243854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 308/629] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:33.253098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09034a-69d6-4c3a-be65-e824da8d9faa None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:33.278533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.299805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:33.300847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.301998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.302496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.303564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:33.304082 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:33.305733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:33.325423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 322/630] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:33.331017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.394107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aae020-ce22-4c71-ba5b-bc758a1983cc None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:33.432798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:33.433945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.434457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.434954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.445786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:33.453846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:33.455648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 309/631] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:33.461392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.490188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819ee1-e7e6-4554-b404-0d9a0f58a274 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:33.569853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296355ad-0318-4eac-86ed-5bd58119cbd4 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:33.587253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:33.587908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.588195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.588482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.610727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:33.611402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.611680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.611951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.612696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:33.612998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:33.614451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:33.628154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 310/632] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:33.634932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.712944 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:33.714872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:33.812393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71227350-af6e-4ab0-ae84-1c43e623447e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:33.862739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 323/633] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 26 13:51:33.864078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:33.865240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:33.865765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:33.866263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:33.870958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.886147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:33.887888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:33.917929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:33.926429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 311/634] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:33.932676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:33.973102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807d104-ebec-45e3-99e0-cbe8d01b3cc6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.013380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.014683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.015351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.016080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.029241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.031594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.053453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c42e7-7da4-49a0-85bd-13f118b912ce None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.054098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-03998cf7-0aa2-4d92-8f3c-c40ead6b7a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:34.056764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 324/635] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:34.058183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd630-fe8a-4334-9a54-4cfa752d5920 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.058644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd630-fe8a-4334-9a54-4cfa752d5920 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.059069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabd630-fe8a-4334-9a54-4cfa752d5920 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.065442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 325/636] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:34.065442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd630-fe8a-4334-9a54-4cfa752d5920 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.092545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.093214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.093539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.093816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.094712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:34.094890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.096374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee55d55-8c56-41b9-a9ed-caa2c3db624a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.109827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 312/637] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:34.111197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.111478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.112534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.130476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:34.131582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:34.196166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabd630-fe8a-4334-9a54-4cfa752d5920 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.209996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 313/638] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:34.209996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.255646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.257454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.258005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.258494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.259427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:34.259960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.261951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.277429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 326/639] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:34.278755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.327676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb0985-f59d-44ce-a132-d342e6ad41f4 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.371620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.372913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.373348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.373771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.384542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.386525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.387214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ad94d-0c9c-4aa2-8849-f4d68e8b3cae None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.404576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:51:34.406355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 314/640] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:34.407285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.439060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.439865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.442740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.442740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.460053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:34.472151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:34.474841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 327/641] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:34.476001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.534173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853aae6-aaf7-4ebe-9b7e-4f78c9f94e20 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.570791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.571600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.571876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.572150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.578710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.580181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.593356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:34.600284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 315/642] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:34.600284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.607096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1d267-7c99-4566-9603-f917b81ede41 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.647394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.647975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.648254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.648524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.649360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:34.649662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.651143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078b829-fa19-4348-a9cd-ed990682c0c0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.669881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 328/643] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:34.671301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbba2-78af-48ec-874a-8a6051d278ea None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.671664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbba2-78af-48ec-874a-8a6051d278ea None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.672010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cbba2-78af-48ec-874a-8a6051d278ea None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.673885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 329/644] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:34.679009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cbba2-78af-48ec-874a-8a6051d278ea None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.704975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb9102-40d5-484a-bf9d-dd4cf7d1bab9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.738792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.739967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.740282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.740536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.741507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:34.741826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.743232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.755662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 316/645] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:34.755662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.794556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cbba2-78af-48ec-874a-8a6051d278ea None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.829384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.830292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.830747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.831165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.832086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:34.832592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.834024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a8918-035a-4799-95fe-5863271ae3cb None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:34.845294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 330/646] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:34.846432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.846725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.847001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.863694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084804d-e681-4d56-bc61-03385dcc7a97 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:34.866916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:34.868097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:34.902990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:34.903946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:34.904319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:34.904769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:34.962000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 331/647] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:34.962000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:34.997591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:34.999153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.055917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31cd18-2f36-43d4-8faa-3936dc9d5171 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.090526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.091319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.091603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.091881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.098885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 317/648] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:35.099946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.106921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.108387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.125037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:35.130528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 332/649] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:35.130528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.204079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798b503-7fd4-42a8-a909-b717c535e544 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.228558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e87e3b-d1c8-4c75-a846-9e30b7733d7b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.239622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.240529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.240817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.241097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.241923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=2132fa7fbd034deb938e9032ec710d7a) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:35.242267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.243712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.249813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 318/650] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/role_assignments?user.id=2132fa7fbd034deb938e9032ec710d7a&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:35.250652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.262920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.264061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.264560 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.265018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.278448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:35.286248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:35.288564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 333/651] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:35.289741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.394571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0f56f-3a7e-4543-b76e-d240e852e724 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.396061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867636a-6635-4a3a-86a4-8763450e04c0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.431672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.432854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.433760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.434526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.435466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:35.435939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.437516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.448507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.449319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.449598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.450097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.458840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 334/652] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:35.460473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.463427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.464675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.482726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:35.484241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 319/653] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:35.485044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.577593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1212f32-dceb-496c-960b-d382d33bdd73 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.608562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959a8ee-934e-46d7-93e5-36957b30ea75 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.612492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.613396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.614485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.614995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.615952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:35.616479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.618103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.627005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 335/654] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:35.628073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.643392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.644215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.644761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.644761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.652079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.653536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.667854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 26 13:51:35.673780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 320/655] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:35.673780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.734590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb1e8b-6dec-4c53-8d96-34ae7fc0bae1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.769315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.770017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.770308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.770589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.771316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:35.771626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.772627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37e9fc-280d-4295-9646-b1fd76db0103 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.772985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a96b-9738-4d82-8f54-786dab499f52 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.786683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 336/656] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:35.788232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e841c04-0843-4e1e-aec3-834405676c99 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.788523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e841c04-0843-4e1e-aec3-834405676c99 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.788802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e841c04-0843-4e1e-aec3-834405676c99 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.794779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 337/657] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:35.794779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e841c04-0843-4e1e-aec3-834405676c99 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.811955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.813161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.813594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.814055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.824831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.826567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.844586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:35.846015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 321/658] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:35.846923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:35.897349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e841c04-0843-4e1e-aec3-834405676c99 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.932381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.933052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.933340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.933894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.934487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:35.934861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.936225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07afa8b-5f20-4b77-a69e-cb8f4fcc7c20 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:35.945648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8a7c8-91c8-4cf6-827e-bed4619977d0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:35.955559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 338/659] 10.222.0.23 () {56 vars in 1137 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:35.956763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.957056 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.957331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.972765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:35.974523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:35.983961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:35.984823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:35.985055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:35.985335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:35.993136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:35.994705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.008027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:36.009196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 322/660] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:36.009961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.045476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 339/661] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:36.047170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.113092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776f3dc-6666-4a7a-aa5c-4573a218ae45 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.145808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.146493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.146779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.147059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.147774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:36.148085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.149455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.157181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228fb79-320c-42e8-8186-6a23dca1cbd4 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.165778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 323/662] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:36.165778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.193753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.194432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.194720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.195021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.264260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad1242-3019-4cf8-98eb-eed6e865f346 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.265586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.267077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.300978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.302228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.302515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.302790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.303576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:36.303885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.305331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.321391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 324/663] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:36.321391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.371810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 340/664] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:36.371810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.423554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b45ba-1728-4955-9f4a-99112a68dd95 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.465352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.466632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.467402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.468081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.469702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25523af7-f555-477c-ac13-8f10ddbfed0a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.479236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:36.486449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:36.487661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 325/665] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:36.488426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.507506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.508604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.509080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.509960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.519031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.521131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.534738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 26 13:51:36.536850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 341/666] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:36.538043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.591083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c045890-ad8c-452c-9217-5943c3eae725 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.624701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.625352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.625637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.625915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.626764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=8b647906359a4d8bb2e0cf3098d62967) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:36.627085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.628519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.634311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 326/667] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/role_assignments?user.id=8b647906359a4d8bb2e0cf3098d62967&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:36.635223 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.637428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811ddbf-b12c-454d-af05-e69ced9116d2 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.676016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.676886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.677176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.677461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.689405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.694226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.709583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:36.715229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 342/668] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:36.715229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.752708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa6dee-2805-4f05-862a-613763041577 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.789223 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.790183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.790605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.791017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.791944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:36.792392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.793928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.803391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 327/669] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:36.804522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.820245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c216a-8a1d-4e4f-be7c-1bcd2c0873fe None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.855527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.856202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.856494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.856770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.857620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:36.857932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.859398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.877443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 343/670] 10.222.0.23 () {56 vars in 1139 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:36.878286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:36.928829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce286609-d676-4331-95b4-2ce0b2e8465a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.967616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:36.968285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:36.968572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:36.968852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:36.969578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:36.969884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:36.971301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:36.981075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cec4cf-a5c3-4603-8cef-b41b032e4ea7 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:36.985882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 328/671] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:36.986963 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.015903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.016790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.017158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.017427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.028410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.030085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.047342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:37.048858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 344/672] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:37.049782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.088394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51add4a4-0487-4ce8-a5c1-f0907f3f5429 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.123243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.124197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.124692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.125172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.149266 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8dd3c-679b-4203-b6cf-6c2f8be29259 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.183127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.183933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.184231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.184483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.191455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.193706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.195910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.197584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.207009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:37.208538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 345/673] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:37.209471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.296589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 329/674] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:37.297819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.307652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0886-7161-4960-9ca3-27096f6f7590 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.341512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.342202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.342491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.342771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.343508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:37.343814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.345295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.356739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 346/675] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:37.357558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.401640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083e6cd-0e61-4d63-979c-5c2ea397c428 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.446079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.447647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.448302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.449076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.450130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:37.450644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.452768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.463585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33451d-10fb-4381-bfa8-646450315b1e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.469181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 330/676] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:37.470287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.500826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.502294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.502936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.503743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.519537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.521944 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.544555 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:37.546816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 347/677] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:37.548650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.582602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6145aa-0426-4708-bf51-39154d451da6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.626415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.627569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.628054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.628533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.638855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.640734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.655958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cdd28-9234-4c35-95be-acb3ca6ff6ff None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.658879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 26 13:51:37.661167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 331/678] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:37.662212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.692865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.696613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.696613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.696613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.696613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=57a82877b3b14091b942181b4887edff) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:37.696613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.696967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.703135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 348/679] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/role_assignments?user.id=57a82877b3b14091b942181b4887edff&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:37.704003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.796805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba5150-8417-4598-b37f-da9523a3b3d7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.811942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287c0f4-c6a5-449f-a8d4-29814089aa7e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:37.849422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.850502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.851088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.851566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.852380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:37.852763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:37.853062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.853348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.853630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.853882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.854608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:37.854922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:37.855976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5524571-5ec9-407a-98b0-3405f0fd2fd6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.856472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:37.870755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 332/680] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:37.872517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa3cd-5ad5-4c7c-99f7-aba152f7c61f None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.873039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa3cd-5ad5-4c7c-99f7-aba152f7c61f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.873550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631aa3cd-5ad5-4c7c-99f7-aba152f7c61f None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.879710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 349/682] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:37.879710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.880109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 333/682] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:37.881707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:37.882244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:37.882757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:37.900871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:37.902527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:37.986846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 334/683] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:37.987538 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:37.993008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77a5eb-6414-4492-ad98-7c082065179b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.033712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.034562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.034867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.035127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.044391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.045831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.058937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:38.060417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 350/684] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:38.061205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.101406 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22322f-9490-49d5-b1d1-c2a4df704abd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.145471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.146462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.146844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.147947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.178398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec16d99-f12a-4019-81d7-a307b1b7207d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.212693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.214285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.214868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.215428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.227761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.229426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.229677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.231237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.256020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:38.262493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 351/685] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:38.263058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.344782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 335/686] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:38.345637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.380410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b95dd5-a9a1-467b-8ec9-149abe89eaa3 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.415457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.416473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.416964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.417441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.418504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:38.419017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.420651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.442899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cd047-7b8f-4128-9ff5-2223a81a9cd9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.444991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 352/687] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:38.446218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.477496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.478232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.478792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.479067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.480052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:38.480371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.481740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.500665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 336/688] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:38.500665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.561687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49277eed-d2a1-46ca-afa1-329c7edb8959 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.601623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4987fa-9fd4-42bb-ba0c-5b5d8e820cdd None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.603327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.604346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.605468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.605820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.618992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.621223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.642045 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:38.643749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 353/689] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:38.645351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.646848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.647504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.647781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.648101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.648978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=7b30d840c80a46799c0ac7d70daf0e5d) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:38.649510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.651859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.658267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 337/690] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/role_assignments?user.id=7b30d840c80a46799c0ac7d70daf0e5d&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:38.659082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.766483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ffa22-b8b1-4c01-be9d-6cf962b1631c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.783738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66931e56-f547-4c45-acbc-0854d69b6b78 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:38.802034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.802671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.802951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.803225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.804225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:38.804335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.805697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.817889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 338/691] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:38.823508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:38.842105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:38.843402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:38.843805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:38.844085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:38.844810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:38.846290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:38.952775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 354/692] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:51:38 2022] POST /identity/v3/users => generated 254 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:38.960327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf7645-eef8-4fef-8137-4f24658dcd04 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:39.002411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:39.003636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.004686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.005244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.013728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:39.015617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:39.031520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:39.033521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 339/693] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:39.039523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:39.157761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baf54d-fb30-40fe-ba3d-b36e9071c82d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:39.201890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:39.202588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.202925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.203148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.203943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:39.204249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:39.205671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd08a72-b646-4ff7-bae2-2acf0586265a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:39.219148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 355/694] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:39.225134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:39.279280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7aac6-ff40-463a-9d91-13cef16fedef None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.279620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7aac6-ff40-463a-9d91-13cef16fedef None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.279845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7aac6-ff40-463a-9d91-13cef16fedef None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.281756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 356/695] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:39.288585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.288873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.289153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.309086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:39.310732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:39.336106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a53830-a1fe-495c-8a1f-fd5b30d3a182 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:39.380884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:39.381842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.382158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.382436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.383264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=e24a392a4a96416bb50306d6443036ca) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:39.383579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:39.385015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:39.390094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 357/696] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:39.391461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 340/697] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:39 2022] GET /identity/v3/role_assignments?user.id=e24a392a4a96416bb50306d6443036ca&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:39.409341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:39.522619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfb696-a959-408b-b2e4-5699d640672a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:39.568938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:39.569755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.570062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.570344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.583805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:39.594871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:39.596484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 358/698] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:39.602952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:39.729786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d83b-cf54-4248-a6d4-34b340bbe35b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:39.766372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:39.767317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.767638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.767914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.768664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:39.768963 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:39.770394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:39.779493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 341/699] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:39.784659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:39.889838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1a4f-8fc2-4fca-9f06-cc89045fb894 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:39.928371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:39.929177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:39.929463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:39.929739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:39.944490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:39.946129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:39.979224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:39.980831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 359/700] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:39.986318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.089232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20ac6a-6e3d-41c2-9880-8226dddf27a0 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:40.129031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:40.129739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.130045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.130328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.131046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:40.131348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:40.132710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31377-7ce9-4295-98a0-3d001d55e0fe None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:40.145408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 342/701] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:40.150940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.274615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9caa14-d590-4ddf-91e3-6ca5712887cf None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:40.323162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a08e2-4f81-4ca5-ab62-e5e6726ade14 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.323785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a08e2-4f81-4ca5-ab62-e5e6726ade14 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.324264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a08e2-4f81-4ca5-ab62-e5e6726ade14 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.326557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 343/702] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:40.329605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:40.330087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.330371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.330643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.333283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.333571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.333852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.339361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:40.340726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:40.355836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:51:40.357488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 360/703] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:51:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:40.361559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:40.366953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:40.371113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.460885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 344/704] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:40.495217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.572117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226d52-a9f4-4867-8c54-65ae6cc90867 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:40.591977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b496-567a-483a-8efd-991567c1c6c2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:40.628828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:40.633072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.633072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.633072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.633072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:40.633072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:40.652844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 26 13:51:40.657486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:40.658196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.658481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.658752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.659595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:40.659900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:40.661378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:40.664635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 345/705] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Apr 26 13:51:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:40.671521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.702670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 361/706] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:51:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:40.708965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.815754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4010e9f-cf66-4057-a8d8-85b9b3986400 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:40.856415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:40.857319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.857616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.858188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.862663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8ac1e-48ba-4b2c-9bf1-97127a627f0f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:40.921755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:40.922454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:40.922737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:40.923014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:40.923719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:40.924025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:40.928642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:40.939208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 346/707] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 26 13:51:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:40.946909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:40.973370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:40.974994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.063572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e41b3-4281-4b02-a681-524b7eddd40e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:41.077851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 362/708] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:41.084413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:41.125160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:41.125820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.126139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.126418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.127146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:41.127454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:41.128894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.136993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 347/709] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 26 13:51:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:41.269552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98189477-8578-4f96-8bdc-a5fd6395dc5c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:41.327714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:41.328916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.329341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.329755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.352299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:41.354058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.376115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-8de7193a-cbb4-4ebd-ae96-c1065bbc4822 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:41.377647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 363/710] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:41.383259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:41.503855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64099f57-bece-4e49-ba3a-21d20f273e8e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:41.537474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3dce9-02e4-4e3e-9938-c575d92402eb None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.538103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3dce9-02e4-4e3e-9938-c575d92402eb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.538394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3dce9-02e4-4e3e-9938-c575d92402eb None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.540852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 364/711] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:41.541367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:41.542426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.542930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.543411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.544448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:41.544972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:41.545777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.546101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.546453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.547215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.566279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:41.567933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 348/712] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:41.568051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:41.573561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:41.647742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 365/713] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:41.669913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:41.781539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5bc8a-163d-419e-9c60-3bc455547b22 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:41.800259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b664160-a430-423e-8593-6cff0ceb0b81 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:41.818475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:41.819281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.819569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.819850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.820523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:41.821895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.834862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 26 13:51:41.836365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 366/714] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:41.842068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:41.891831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:41.893016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.893502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.894017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.907205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:41.908897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.942321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:41.944539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301c4e2-5fc7-4881-862c-075446ebdec2 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:41.948470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 349/715] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:41.954948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:41.980450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:41.981482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:41.981993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:41.982545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:41.983469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] RBAC: Adding query filter params (name=network) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:41.983980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:41.985559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:41.991356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 367/716] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:41.996954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:42.103916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6086c3-ab3b-44be-94af-64f33f0ebeee None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:42.138917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:42.139929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.140448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.140940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.141860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] RBAC: Adding query filter params (type=network) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:42.142390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:42.144130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:42.150455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 368/717] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:42.172498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c8f26-acfb-434e-9c99-25b810bf83f3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:42.213774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:42.214500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.214786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.215062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.215899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:42.216210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:42.217732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033c930-46ba-4a5e-af17-b1c7fbe8e195 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:42.241354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 350/718] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:42.247393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:42.314918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e3c5-7430-421e-a1a1-0958e81f9208 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.315247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e3c5-7430-421e-a1a1-0958e81f9208 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.315460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20e3c5-7430-421e-a1a1-0958e81f9208 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.317587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 351/719] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:42.322590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2b84-d341-44e6-80a8-713c61b5d202 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.322873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2b84-d341-44e6-80a8-713c61b5d202 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.323145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2b84-d341-44e6-80a8-713c61b5d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.363068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-27fd2b84-d341-44e6-80a8-713c61b5d202 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:42.364926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-27fd2b84-d341-44e6-80a8-713c61b5d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:42.386318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb58c9-c76f-47c6-9504-d40a0f17d0de None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:42.426435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:42.427550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.428054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.428532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.429576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=8b647906359a4d8bb2e0cf3098d62967) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:42.430151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:42.431819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:42.443145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 369/720] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:42 2022] GET /identity/v3/role_assignments?user.id=8b647906359a4d8bb2e0cf3098d62967&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:42.473956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 352/721] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 26 13:51:42.499071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:42.611960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e34f-7bad-4bce-a46a-8b411d814146 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.612313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e34f-7bad-4bce-a46a-8b411d814146 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.612526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85e34f-7bad-4bce-a46a-8b411d814146 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.614446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 353/722] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:42.622447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.622795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.623005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.625128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad5b5-3972-419e-aff7-3c0dc33f70fd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:42.654785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:42.656258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:42.663468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:42.664281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.664569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.664908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.678132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:42.685362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:42.687330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 370/723] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:42.699085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:42.750549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 354/724] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:42.784144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:42.891452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f016ab2-d1d2-417f-943d-d663f45f809c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:42.956985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e640b-95f8-4040-8318-ff72f834f596 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:42.960816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:42.961482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:42.961764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:42.962664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:42.966009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:42.966009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:42.966009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:42.974003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 371/725] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:42.979265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.034684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.035526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.035816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.036096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.067379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:43.074326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:43.082060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2628637-b116-45e5-9725-7c59bd17d953 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.082981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 355/726] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:43.088968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.150630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.151433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.151718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.151998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.177936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.179443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.217572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:43.219883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 372/727] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:43.225418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.266237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3cc4f2-e8e5-4040-9137-22ee8607fe08 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.300729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.302330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.302817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.303321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.304276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:43.304781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.306423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.315297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 356/728] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:43.320857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.403773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74625c0-c2c3-491d-8573-21140cf1174e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.450609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18eed9d-8fb5-48f7-8786-68658a88fd8d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.468754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.469419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.469710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.470008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.470752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:43.471060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.472497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.483997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.484974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.485345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.485693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.497802 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.500116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.503132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 373/729] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:43.508461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.518298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:43.519853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 357/730] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:43.528545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.669440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd785d-240f-47b8-b19b-b87afd5f9997 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.708442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.709293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.718059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.718059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.718059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.719656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.720820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63e26b-fc75-44bb-8047-8df2b8fa8d14 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.736556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 26 13:51:43.738208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 374/731] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:43.750650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.776494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.777512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.778025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.778529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.779473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:43.779979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.781566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.794907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 358/732] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:43.807319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.882047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9cc90-09a8-4076-817d-9ca5a364c0e4 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.928066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.928746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.929039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.929320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.930196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:43.930513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:43.931945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:43.947507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1677f97-ffa6-403c-bf23-c0d7e000ead5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:43.970089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 375/733] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:43.981820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:43.988819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:43.990263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:43.990755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:43.991251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:43.998742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:44.000419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:44.014534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 26 13:51:44.016307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 359/734] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:44.027379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:44.138725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63c66-e545-4e05-86ac-426f3fd5726b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.142973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31194bae-cb25-42ab-a946-8dca5d132889 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.180158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:44.180991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.181277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.181557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.182746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:44.183188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:44.184845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e4043c-171a-425f-bacb-b7f624f398d5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:44.188675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18db55-61d4-4042-9b81-877a70593712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:44.189623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18db55-61d4-4042-9b81-877a70593712 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.190159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18db55-61d4-4042-9b81-877a70593712 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.190642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18db55-61d4-4042-9b81-877a70593712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.207969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 360/735] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 26 13:51:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:44.209345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c978d75-2f30-4c12-a9f9-2bb720170f5a None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.209641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c978d75-2f30-4c12-a9f9-2bb720170f5a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.209918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c978d75-2f30-4c12-a9f9-2bb720170f5a None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.211897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 361/736] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:44.212603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c978d75-2f30-4c12-a9f9-2bb720170f5a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:44.281763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18db55-61d4-4042-9b81-877a70593712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:44.284062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18db55-61d4-4042-9b81-877a70593712 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:44.319733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c978d75-2f30-4c12-a9f9-2bb720170f5a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.354072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:44.354865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.355248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.355622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.391523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 376/737] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:44.393157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.393603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.394079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.411674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:44.413790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:44.425541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:44.427275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:44.502035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 377/738] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:44.503174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:44.534786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 362/739] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 26 13:51:44.539879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:44.623907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2738c7d-044e-4ce5-8850-3abfef03c6cb None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.644746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cb04a-758a-4a78-91b4-9c893a59cc91 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.661418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:44.663162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.663669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.664160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.678288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:44.679970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:44.680109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:44.680828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.681211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.681584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.682613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:44.684380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:44.699564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:44.700913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 378/740] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:44.705865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:44.802459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 363/741] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:51:44 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:51:44.803774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:44.917638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9facb-aa5e-4dd1-96fd-467cbb8ca546 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.968631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb8a16-d33a-4e71-9ccb-0cbd51d09206 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:44.982502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:44.984029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:44.984428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:44.985087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:44.999601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.001831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.005278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.005962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.006266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.006535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.007263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:45.007561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.008985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ab4cc-2e89-409e-b9d6-1a8c0d7c1946 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.021916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 364/742] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:45.023059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-cb87fc94-c24f-4f58-a5ec-72b9604fb00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:45.023170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97831-9b17-4bb1-a38d-cf599a2bd9c4 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.023245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97831-9b17-4bb1-a38d-cf599a2bd9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.023480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b97831-9b17-4bb1-a38d-cf599a2bd9c4 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.023884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 379/743] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:45.025174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a2bc-a3e7-465a-9732-ef755eb86a82 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.025365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 365/744] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:45.025528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a2bc-a3e7-465a-9732-ef755eb86a82 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.027859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113a2bc-a3e7-465a-9732-ef755eb86a82 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.028118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 380/745] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:45.030100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97831-9b17-4bb1-a38d-cf599a2bd9c4 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.030700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25850-69e5-4edf-ae66-b792d0c20939 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.031063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25850-69e5-4edf-ae66-b792d0c20939 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.031415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25850-69e5-4edf-ae66-b792d0c20939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.050640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0ed25850-69e5-4edf-ae66-b792d0c20939 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:45.051878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0ed25850-69e5-4edf-ae66-b792d0c20939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:45.118918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 381/746] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:45.120361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.120660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.120941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.137598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:45.139109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:45.147098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b97831-9b17-4bb1-a38d-cf599a2bd9c4 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.181134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.181935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.182252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.182541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.189396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.190917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.203945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 382/747] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 26 13:51:45.204700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.212002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:45.212438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 366/748] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:45.213498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.306952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834d7be-51d5-43e6-8a93-623c2f888388 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.307316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893becf-c362-44db-b50f-d3d3f870938a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.340079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.340489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.340733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.341012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.341171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.341282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.341430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.341704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.341991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:45.342312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.342484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.343656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.343817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.354400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 383/749] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:45.355178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.453995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbeebd-a4a0-4d5d-98c6-83a09b992ab8 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.455111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 367/750] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:51:45 2022] POST /identity/v3/services => generated 240 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:45.456272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.491311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.491992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.492307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.492589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.493727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:45.494087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.496558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.514592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 384/751] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:45.516660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.586012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae86ec5-58a6-4373-a907-7cfc95bd3981 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.626359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.627219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.627464 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.627882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.639315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:45.646217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5d226-c007-4820-b0df-52e81d4eff9b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.647791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:45.649349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 368/752] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:45.649879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.684247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.685389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.685673 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.685946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.695244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.696540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.712335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:45.713960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 385/753] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:45.714862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.754947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc71fba-a451-4179-90ee-ad6f61e6a4fe None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.794176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.794860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.795148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.795626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.796462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=ad9df8bc03b54ac5bc828e3343158371) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:45.796769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.798226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.804051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 369/754] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/role_assignments?user.id=ad9df8bc03b54ac5bc828e3343158371&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:45.804845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.818768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28741c7b-3132-49db-bfa9-5db6d6b05ed5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.855355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.856045 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.856335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.856615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.857401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:45.857712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.859204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.873096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 386/755] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:45.874359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.908968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ecaef-02c1-4346-8279-231e1d06120f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:45.944712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:45.945434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:45.945656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:45.945926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:45.946741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:45.947045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:45.948478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:45.962186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 370/756] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:45.971299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:45.980283 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f6dbc-e1f5-461b-88ea-cefda5ceb6f7 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:46.016271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:46.017083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:46.017369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:46.017646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:46.030066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:46.031564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:46.049336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:46.055365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 387/757] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:46.056670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:46.131512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b0da7-343a-4d40-8ed1-658c51b391f3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:46.198366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831982-da38-447f-8321-861825297b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:46.198948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831982-da38-447f-8321-861825297b99 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:46.199224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831982-da38-447f-8321-861825297b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:46.199493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85831982-da38-447f-8321-861825297b99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:46.200317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831982-da38-447f-8321-861825297b99 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=e24a392a4a96416bb50306d6443036ca) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:46.200621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831982-da38-447f-8321-861825297b99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:46.202069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85831982-da38-447f-8321-861825297b99 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:46.212609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 371/758] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:45 2022] GET /identity/v3/role_assignments?user.id=e24a392a4a96416bb50306d6443036ca&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:46.233645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb925517-3113-4b7d-837a-4efd9fe89bff None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:46.284110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:46.284921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:46.285256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:46.285532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:46.286312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:46.286618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:46.288365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:46.312447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 388/759] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:46.318832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831982-da38-447f-8321-861825297b99 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:46.428197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85831982-da38-447f-8321-861825297b99 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:46.481118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:46.481850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:46.482164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:46.482444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:46.490245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:46.491688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:46.505259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:51:46.509777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 372/760] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:51:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:46.515054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:46.670206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf42ce-f7be-472a-9d83-7799c20e4106 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:46.718677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:46.719403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:46.719690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:46.719968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:46.720816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:46.721126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:46.723138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:46.742232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 389/761] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:46.747338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:46.879096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79921d-1281-42f3-b574-532c74c4ebb2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:46.917029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:46.917832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:46.918138 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:46.918413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:46.928554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:46.930032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:46.954783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:46.956325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 373/762] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:46.962200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:47.110527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fc99-2ceb-45a4-900c-d776ed67071b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:47.162103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:47.163028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:47.163316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:47.163592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:47.164320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:47.164624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:47.165996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:47.177705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 390/763] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:47.182944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:47.302254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240f36-9a0b-4952-ae79-dae63568f907 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:47.341402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:47.342230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:47.342606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:47.342796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:47.349610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:47.351103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:47.366947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:47.368393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 374/764] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:47.374312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:47.503739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89404cb-86f4-48d7-8080-63b6b6f670c6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:47.545461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:47.546284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:47.546473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:47.546821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:47.547690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:47.548015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:47.549512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ac97f-3e4c-4982-84ec-eb2706f1cc72 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:47.569110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 391/765] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:47.571078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:47.700083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc5963-b87b-47de-8bf6-8546db4ce755 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:47.715594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0729e-91e3-4d2e-8fcb-536e2f9f069c None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:47.715936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0729e-91e3-4d2e-8fcb-536e2f9f069c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:47.716164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0729e-91e3-4d2e-8fcb-536e2f9f069c None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:47.719707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 392/766] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:47.724385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8055-4169-4cc2-aacc-68b5522d399b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:47.724954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8055-4169-4cc2-aacc-68b5522d399b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:47.725430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8055-4169-4cc2-aacc-68b5522d399b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:47.734519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:47.735686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:47.736177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:47.741519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/8b647906359a4d8bb2e0cf3098d62967/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:47.744016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=8b647906359a4d8bb2e0cf3098d62967, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:47.745809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:47.755504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-97fc8055-4169-4cc2-aacc-68b5522d399b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:47.756935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-97fc8055-4169-4cc2-aacc-68b5522d399b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:47.820295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 375/767] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:47 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/8b647906359a4d8bb2e0cf3098d62967/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:47.845495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 393/768] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:51:47.891600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.031742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660e97d-67d1-4b56-8c68-7d67f9cc198d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.072755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.073583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.073865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.074201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.074859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.076237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.082523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b227-f806-4882-ad55-34678e51ae14 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.082523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b227-f806-4882-ad55-34678e51ae14 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.082523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847b227-f806-4882-ad55-34678e51ae14 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.084371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 394/769] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:48.089121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 26 13:51:48.091786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.092075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.092353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.092670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 376/770] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Apr 26 13:51:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:48.096430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.114941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:48.116135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:48.183912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 395/771] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:48.207004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.215532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f88e8-441b-4bd9-a305-da146af511e8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.250986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.252018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.252508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.252984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.253943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:48.254507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.256576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.267722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 377/772] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:48.269602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.354732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d0450-18aa-4eca-baa2-8fad57f39e00 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.422553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.423352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.423636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.423909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.424575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.425992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.445229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 26 13:51:48.452288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 396/773] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:48.460529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.467000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff7a1b-b6ef-47da-a463-2387fd72c00f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.539116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2513e-f24d-450e-a965-76174181959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.539784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2513e-f24d-450e-a965-76174181959c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.540065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2513e-f24d-450e-a965-76174181959c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.540337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2513e-f24d-450e-a965-76174181959c None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.541045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2513e-f24d-450e-a965-76174181959c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:48.541349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2513e-f24d-450e-a965-76174181959c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.542824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2513e-f24d-450e-a965-76174181959c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.553342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 378/774] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:48.559127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2513e-f24d-450e-a965-76174181959c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.674586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2513e-f24d-450e-a965-76174181959c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.692154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b5d825-f23c-4e3f-ac07-4beb029f38a2 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.718712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.719393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.719678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.719955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.720755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] RBAC: Adding query filter params (interface=public, service_id=8e32f34c0c734a5bb6f1a72d05d4b5df, region_id=RegionOne) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:48.721066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.722492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.740217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 379/775] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/endpoints?service_id=8e32f34c0c734a5bb6f1a72d05d4b5df&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:48.741420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.742166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.742458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.742810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.743573 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] RBAC: Adding query filter params (name=network) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:48.743929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.745276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.751205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.760252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 397/776] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:48.771960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:48.888060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3fff1-3aac-4db3-9839-e66cdc71f314 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.918331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346537b2-44e3-4d97-b2df-debc11412d9d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:48.921312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a84d5-df9a-4339-89f0-e703c10ed8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.921986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a84d5-df9a-4339-89f0-e703c10ed8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.922287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a84d5-df9a-4339-89f0-e703c10ed8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.922558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a84d5-df9a-4339-89f0-e703c10ed8d7 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.923230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a84d5-df9a-4339-89f0-e703c10ed8d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.924659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a84d5-df9a-4339-89f0-e703c10ed8d7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.930301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 380/777] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:48.931545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9872672-c950-438a-b025-a84a3bf9fd25 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.931815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9872672-c950-438a-b025-a84a3bf9fd25 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.932086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9872672-c950-438a-b025-a84a3bf9fd25 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.938105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 381/778] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:48.939583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d844a-cf8e-47ab-bfbb-ec7b0d042281 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.939866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d844a-cf8e-47ab-bfbb-ec7b0d042281 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.940137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d844a-cf8e-47ab-bfbb-ec7b0d042281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.966108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:48.966796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:48.967077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:48.967353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:48.968076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] RBAC: Adding query filter params (type=network) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:48.969406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:48.970850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:48.973218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-594d844a-cf8e-47ab-bfbb-ec7b0d042281 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:48.974518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-594d844a-cf8e-47ab-bfbb-ec7b0d042281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:48.987526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 398/779] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:48.993091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.068351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 382/780] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:49.069750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cddbba-9c01-42fd-983f-5012fbe41f6f None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.070063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cddbba-9c01-42fd-983f-5012fbe41f6f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.070344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cddbba-9c01-42fd-983f-5012fbe41f6f None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.076428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 383/781] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:49.077849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.078160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.078435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.096298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:49.097500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:49.139935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362164-4269-4cd4-8dad-4d3bec7de95b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.172850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 384/782] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:49.173544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.206646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.207268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.207574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.207849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.208644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] RBAC: Adding query filter params (interface=public, service_id=47327f8e40c247ec9d0665efd7647228, region_id=RegionOne) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:49.208956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:49.212264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:49.221078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 399/783] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:51:48 2022] GET /identity/v3/endpoints?service_id=47327f8e40c247ec9d0665efd7647228&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:49.222329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.301409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bda18d-ac43-4034-a29f-666b8bc7939d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.329738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6318413-a9ef-4f9e-94ed-8b1510c0f4ee None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.343051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.344234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.344523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.344797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.357732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:49.364628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.365672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.366219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.366697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:49.366818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.368381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 385/784] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:49.369335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.385178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:49.394051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:49.398050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 400/785] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:49.399243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.483835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a71e2-fb0a-421e-b2ff-f52265e0ee50 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.500272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3164fd7-2395-4a7e-8ace-bfb238cbd867 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.517323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.518281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.518757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.519236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.520125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:49.521708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:49.527288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 386/786] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:49.528252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.551819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.553000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.553508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.554029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.555036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:49.555549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:49.560018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:49.581983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 401/787] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:49.587803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.733284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c31ca2-100a-4f33-ae4a-76bd373ff726 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.774653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e905a-4557-4f09-91a2-f346fe6bf32e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.778672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.779354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.779638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.779916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.780666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:49.780971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:49.782855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:49.792177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 387/788] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:49.798283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.821800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.822618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.822904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.823245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.834120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:49.835592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:49.853745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:49.855261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 402/789] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:49.860735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:49.902929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f9443-cf6f-4c69-b77a-314f7f885494 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:49.941460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:49.942269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:49.942633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:49.942908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:49.962882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:49.964358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:49.996045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:49.997271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 388/790] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:50.003996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.027486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca092-bcd6-4191-a8a5-0e83ff3a28a1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.081460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.082715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.082996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.083268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.084019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:50.084324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.085745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.106503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 403/791] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:50.112126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.190586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b7a67-57cb-495a-b838-5269a085bdc7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.249388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.250079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.250364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.250638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.251367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:50.251671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.253036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.272651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d6562-594d-479a-8c3e-db68b4b4230d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.277200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 389/792] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:50.283061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.331222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.332567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.332851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.333129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.349461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.352611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.369393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 26 13:51:50.370914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 404/793] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:50.376356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.471940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6471f-7c4c-4f55-b967-5b75a80491a2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.517351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.518479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.518760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.519030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.528929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.530866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.533342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf9f82-bbfa-4d53-95c0-194097d52bd0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.548759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-701c9238-1ede-4660-ba9b-e44d4b549093 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 26 13:51:50.550701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 390/794] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:50.551938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ba7e-6bcb-42d9-979e-fad2c35cc17a None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.552219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ba7e-6bcb-42d9-979e-fad2c35cc17a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.552490 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ba7e-6bcb-42d9-979e-fad2c35cc17a None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.554882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 391/795] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:50.559432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.559704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.562003 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.576696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:50.577089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.577860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:50.578392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.578885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.579450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.581419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:50.582571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.584188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.604735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 405/796] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:50.605571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.663913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 392/797] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:50.663913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.735549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505cacd6-9c3b-4e0c-ba43-f2d462b0123a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.771323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.771720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.772004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.772279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.773120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:50.773433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.774918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.797418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 406/798] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:50.798157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.803523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a9548-36a4-4710-b982-b981de6ea926 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.845866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.847233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.848014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.848495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.862876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:50.866127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:50.888429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:50.894329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 393/799] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:50.895170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.904218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a97d5-d587-42b2-8067-1b4fd4b8a049 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:50.949736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:50.950931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:50.951400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:50.951855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:50.962536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:50.969663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:50.976446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 407/800] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:50.977486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:50.994087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb929d-0893-4e75-ba9f-9eec09e9a2cf None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.027486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.028422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.028800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.029205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.041119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.043205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.062381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:51.063849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 394/801] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:51.068996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.085507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07795a21-e649-4d0b-954f-5892e3973ea8 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.121088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.121993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.122463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.122895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.123756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:51.124206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.125698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.137554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 408/802] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:51.138740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.166962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c63f0-41ed-4c32-afa4-d19d6e1cd3b9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.200983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.201741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.202116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.202515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.203313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:51.203679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.205225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.217920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 395/803] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:51.217920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.249317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54973c2-347c-404e-9d2e-294ee866b3c7 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.294801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.295742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.296028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.296307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.297959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:51.298302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.299678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.314864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 409/804] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:51.315653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.332530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e3462-cc82-4e8c-8052-24ed9879c5f5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.367037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.368021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.368426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.368818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.375914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.377526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.391301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:51.392949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 396/805] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:51.393895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.417102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c650-654a-435c-bfba-5ffb54038ee6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.463349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.464146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.464422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.464693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.475888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.477353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.493851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:51.499743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 410/806] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:51.499743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.516220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c4dad3-4cb6-4b49-a0d3-290ec658512c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.550717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.551512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.551800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.552080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.558569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.560002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.573270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-e29eeed1-bc3e-4d77-be92-6f2c60c9e6ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:51.579047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 397/807] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:51.579047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bf5b-2f60-4eca-acb5-46340911c812 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.579047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bf5b-2f60-4eca-acb5-46340911c812 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.579047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496bf5b-2f60-4eca-acb5-46340911c812 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.579047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 398/808] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:51.579047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496bf5b-2f60-4eca-acb5-46340911c812 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.601501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ef4e-c849-47dd-ac27-a500ae55155e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.634647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.635307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.635590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.635863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.636645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:51.636949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.638389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.650683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 411/809] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:51.651763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.682705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496bf5b-2f60-4eca-acb5-46340911c812 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.719060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.719873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.720149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.720430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.721158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:51.721460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.723428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfd712-c881-4863-ae5a-67f47b8484ab None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.740774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 399/810] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:51.740774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.740774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.740774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.756710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:51.757896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:51.758907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582d10-4e25-4f9c-a377-0dcd8e830abd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.793387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.794558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.795104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.795598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.797348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:51.797846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.799722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.817615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 412/811] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:51.817615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.846062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 400/812] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:51.846062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:51.926186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adab41e-79cf-47fd-bcc0-de39e70a08cd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.946389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a239-2535-400d-ab84-c8c03cd2d68e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:51.959854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.960735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.961015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.961289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/e24a392a4a96416bb50306d6443036ca/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.963261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=e24a392a4a96416bb50306d6443036ca, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.964679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:51.979619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:51.982012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:51.982012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:51.982012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:51.987872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:51.989370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.002627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:51:52.004355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 401/813] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:51:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:52.005095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.036454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 413/814] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:51 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/e24a392a4a96416bb50306d6443036ca/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:52.037207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.120034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be355dc-d74b-4525-8d47-0a7897a1e8d7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.153557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee2468-ac4a-4ceb-bf85-1644b8393498 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.155574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402fa25-b680-46a0-aa42-6f5c80b87cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.156578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402fa25-b680-46a0-aa42-6f5c80b87cff None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.156925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402fa25-b680-46a0-aa42-6f5c80b87cff None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.157205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402fa25-b680-46a0-aa42-6f5c80b87cff None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/ad9df8bc03b54ac5bc828e3343158371/roles/9317c68e1e944d86b668333be048d093` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.172725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402fa25-b680-46a0-aa42-6f5c80b87cff None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=ad9df8bc03b54ac5bc828e3343158371, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.174232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402fa25-b680-46a0-aa42-6f5c80b87cff None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.190775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.192269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.192561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.192841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.193511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.194932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.207068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 26 13:51:52.208514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 414/815] 10.222.0.23 () {56 vars in 1129 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:52.209109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.251542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 402/816] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:51:52 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/ad9df8bc03b54ac5bc828e3343158371/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:51:52.253152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1f5b1-97dc-40b8-ae85-d709fc64f6c2 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.253438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1f5b1-97dc-40b8-ae85-d709fc64f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.253763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1f5b1-97dc-40b8-ae85-d709fc64f6c2 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.256184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 403/817] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:52.256890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1f5b1-97dc-40b8-ae85-d709fc64f6c2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.336280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74778ee5-8deb-4947-b71e-ed74bb260783 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.374861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.375462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.375748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.376028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.376886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:52.377254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.379346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa842d-506a-4d6f-b0ea-962ae25a996f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.388862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1f5b1-97dc-40b8-ae85-d709fc64f6c2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.401869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 415/818] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:52.403308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.403601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.403883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.421580 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:52.422930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:52.429105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.430204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.430768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.431245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.432246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:52.432763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.434499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.440297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 404/819] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:52.442322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.514255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 416/820] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:52.515110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.566028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210d60e-a762-4c2b-9b2c-eb61c08265ce None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.600414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.601123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.601403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.601678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.648754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa2bd8-c5d8-42a6-bdac-a0b65ddc7e04 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.669240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.670746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.691707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.692517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.692929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.693209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.694115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:52.694423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.696460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.706116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 417/821] 10.222.0.23 () {56 vars in 1124 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:52.707011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.782137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 405/822] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:51:52.782990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.819288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f492a-da38-47d6-8897-4cb01fd0c0b9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.853379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.854215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.854506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.854788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] PATH_INFO: `/v3/services/network` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.855449 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.856811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.868474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 26 13:51:52.869954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 418/823] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:52.870776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:52.895548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a6a231-0255-47e8-b751-4a41daf4423f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:52.929719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:52.930334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:52.930618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:52.930893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:52.931626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:52.932996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:52.969399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc11a36-c78b-4c61-8448-8b72548dd400 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.001698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.002516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.002795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.003071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.014327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.015755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.031471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:53.037238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 419/825] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:53.038375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:53.042431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 406/825] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:51:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:53.043980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:53.228346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7bd7-9996-4ef0-a4c9-b580c9c67d28 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.253285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395df5b-8c57-43c0-b7d8-061f87139a47 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.280290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.280964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.281251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.281530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.282334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:53.282691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.284062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.288965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.289626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.289905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.290220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.290460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 420/826] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:51:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:53.290970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:53.291272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.294484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.297553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:53.310894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 407/827] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:53.317394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:53.431544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742de83b-42b3-4f5a-9235-1300994a9ae3 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.437662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fb3e5-3961-4fac-a2d6-e9f84c566a7e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.466884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.467612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.467900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.468227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.468940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] RBAC: Adding query filter params (type=network) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:53.469300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.471561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.477713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 421/828] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:51:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:53.483475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:53.483620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.484231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.484510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.484841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.494826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.496830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.513845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:53.521416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 408/829] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:53.522518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:53.600797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30894d8-5c87-405e-b491-289b28cd9e43 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.642175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.643225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.643747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.644166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.645830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.648633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.705871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff3ae3-2e3d-4fea-98c9-5c77316fb70c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:53.739270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 422/830] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:51:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:53.768456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:53.769140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:53.769986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:53.770273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:53.775016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:53.775016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:53.775016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1983de-2705-4263-a2cc-6e184502e1c5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:53.787396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 409/831] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:53.793171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:54.001031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0f4a4-a623-4456-9d13-ded924cae135 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:54.046911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:54.047585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.047866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.048140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.048994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=8b647906359a4d8bb2e0cf3098d62967) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:54.049307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:54.050919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31b1a5-2460-411b-84cc-e240b44c6355 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:54.061799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 423/832] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:53 2022] GET /identity/v3/role_assignments?user.id=8b647906359a4d8bb2e0cf3098d62967&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:54.461409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec465-8c66-458f-816a-174a86ba8753 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.461720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec465-8c66-458f-816a-174a86ba8753 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.461996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ec465-8c66-458f-816a-174a86ba8753 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.464070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 410/833] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:54.469561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd83b-92e0-481b-8536-13d0b5b57654 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.469855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd83b-92e0-481b-8536-13d0b5b57654 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.470174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd83b-92e0-481b-8536-13d0b5b57654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.487623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d42bd83b-92e0-481b-8536-13d0b5b57654 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:54.488881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d42bd83b-92e0-481b-8536-13d0b5b57654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:54.562091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 424/834] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:54.579216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec465-8c66-458f-816a-174a86ba8753 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:54.679820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ec465-8c66-458f-816a-174a86ba8753 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:54.713918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:54.715478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.715957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.716463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.724313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d5bf8-dd2c-4f55-936f-518bbd69e945 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.724607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d5bf8-dd2c-4f55-936f-518bbd69e945 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.724887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d5bf8-dd2c-4f55-936f-518bbd69e945 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.727101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 425/835] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:54.731050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:54.731976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.732345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.732634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.736588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:51:54.738378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 411/836] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:54.746008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:54.749899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:54.751131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:54.830068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 426/837] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:54.850578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:54.859970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbaf07b-da4a-462f-b1ac-b4d5a99fd88b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:54.901577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:54.902634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:54.903408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:54.903864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:54.905009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:54.905625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:54.907482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:54.918889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 412/838] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:54.926951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:54.973309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af74e07-613e-43c0-99c4-56c639fbe268 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.020490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.022304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.022794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.023274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.036249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8ccc-2437-4e17-a686-92d96b250261 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.037080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:51:55.046403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:51:55.053159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 427/839] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:51:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:55.054781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.075929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.076640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.076928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.077201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.088769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.090266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.106888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:55.108407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 413/840] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:55.114492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.176996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629dd26-00d2-4f27-8d01-d94a979b7016 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.221146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.222404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.222842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.223267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.224732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:55.225316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.227582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.233180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b289189-59f7-4a28-b030-823dd7dc9608 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.242603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 428/841] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:55.245214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.273446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.274468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.274982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.275358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.276356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:55.276773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.279011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.294454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 414/842] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:55.302003 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.370973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba46e39-cf4d-47bf-88b8-8a25dd1ad081 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.412179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.413950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.414534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.415113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.419972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdb150-2775-42eb-b522-24499ddf3d9b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.429589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.431750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.468344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:55.470934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.472002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.473063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.473540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.474315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 429/843] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:55.476108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.482811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.484666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.499706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 26 13:51:55.506215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 415/844] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:55.507873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.599421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b70728-d7b8-4751-b814-643a9000be51 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.609167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf34f8-b911-4fcf-9235-877d3ad9b8b2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.641775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.642476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.642797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.643082 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.643811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:55.644141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.645545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.645797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.646703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.647196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.647668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.648737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:55.649270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.650923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.663259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 430/845] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:51:55.668298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.678786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 416/846] 10.222.0.23 () {56 vars in 1135 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:55.684910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.792405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd03404-bf04-42aa-94bb-6561516e4741 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.794690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d356235-0208-404b-a046-db89772ca1d9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.828905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f55f3-efee-45c2-9af5-2749c85133cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.829252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.830048 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.830349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.830633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.830817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f55f3-efee-45c2-9af5-2749c85133cf None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.831285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f55f3-efee-45c2-9af5-2749c85133cf None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.831792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f55f3-efee-45c2-9af5-2749c85133cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.837641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.839110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.856192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-d9bfb315-bbef-40c3-a812-d670b79389ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 26 13:51:55.858012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 431/847] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:51:55.859524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fae25-0e60-4397-b3d9-030a9be441b4 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.859890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fae25-0e60-4397-b3d9-030a9be441b4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.860244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9fae25-0e60-4397-b3d9-030a9be441b4 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:55.862427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 432/848] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:55.863788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fae25-0e60-4397-b3d9-030a9be441b4 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:55.907657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f55f3-efee-45c2-9af5-2749c85133cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:55.909429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f55f3-efee-45c2-9af5-2749c85133cf None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:55.964279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9fae25-0e60-4397-b3d9-030a9be441b4 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:55.998623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:55.999297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:55.999584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:55.999861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.000694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:56.001002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.002472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.006701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 417/849] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:51:56.008319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628269-9329-4574-bb25-9488661514d3 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.008781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628269-9329-4574-bb25-9488661514d3 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.009057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd628269-9329-4574-bb25-9488661514d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.023198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 433/850] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 26 13:51:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:56.024716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.028592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dd628269-9329-4574-bb25-9488661514d3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:56.029807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dd628269-9329-4574-bb25-9488661514d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:56.106078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 418/851] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:56.106078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628269-9329-4574-bb25-9488661514d3 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.143533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c8665-6d7b-4c23-b87b-6a9d39990fae None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.182719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.183617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.183902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.184177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.194109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.195574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.199027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd628269-9329-4574-bb25-9488661514d3 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.213245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:56.218971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 434/852] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:56.218971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.238891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.240003 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.240798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.241526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.309930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.311423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.311528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f68f3-65e6-4556-b3f9-16222d2fe737 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.345250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.346075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.346364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.346641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.347323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.348682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.360709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 26 13:51:56.366946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 435/853] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:56.366946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.416510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 419/854] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:51:56.417406 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.468916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc94c8-747c-42e9-9b8d-1790a772000b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.501096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.501833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.502211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.502506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.503227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:56.504053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.505411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.516548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89391345-fc57-4656-97d9-a0799306ea59 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.516670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 436/855] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:56.517430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.552136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.552781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.553061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.553334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.554065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:56.554370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.555734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ee2d2-79bc-4cdd-b284-d6fb93fd3882 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.559949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 420/856] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:56.561123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a553696-3470-4cab-ad18-ae0752c6cf71 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.561404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a553696-3470-4cab-ad18-ae0752c6cf71 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.561679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a553696-3470-4cab-ad18-ae0752c6cf71 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.563332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 421/857] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:56.567264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a553696-3470-4cab-ad18-ae0752c6cf71 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.611216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67b8ce-c0e8-4bca-b6ba-a0643f1292f8 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.643422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.644221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.644503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.644779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.654389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.655812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.660530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a553696-3470-4cab-ad18-ae0752c6cf71 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.672081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:51:56.673242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 437/858] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:56.674020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.693319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.697155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.697155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.697155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.700997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.702451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.715062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a0f21040-68a7-401a-85cb-a444248739cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:56.716107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 422/859] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:56.717309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.717589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.717854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.734330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:56.735525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:56.767663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24b1b1-5799-4d92-b58f-a089b2b6d263 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.798971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 423/860] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:56.799819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.808833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.809494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.809777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.810089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.810798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:56.811103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.812456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.818576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 438/861] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:56.819677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.904091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79480868-2828-4347-aa8a-17acecf79a24 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.933833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fb3b7-e031-44fd-8546-2d58848d5ec8 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:56.940758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.942133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.942318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.942776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.943525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:56.944009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.945337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.961845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 424/862] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:56.961845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:56.974119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:56.974796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:56.975087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:56.975373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:56.976187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:56.976503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:56.978002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:56.991153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 439/863] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:56.992024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:57.069601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0f5cd-bc56-4614-8754-72ff007e6f6d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.091571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdac84-5124-4578-ac7e-b259e2f770c0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.101747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.102588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.102867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.103137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.103800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.105155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.116923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 26 13:51:57.123091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 425/864] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:57.123091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:57.126397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.127181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.127465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.127739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.134552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.135980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.151032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:51:57.152264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 440/865] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:51:57.153027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:57.231907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56acdf0-5d00-4739-b7ff-7c089fccbfa4 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.258382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b776c1-f291-4358-bb24-3b999b2e6542 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.268819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.269761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.270076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.270356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.271345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=e24a392a4a96416bb50306d6443036ca) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:57.272016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.273712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.282318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 426/866] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:57 2022] GET /identity/v3/role_assignments?user.id=e24a392a4a96416bb50306d6443036ca&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:57.283516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:57.294653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.295777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.296307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.296784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.297894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:57.299139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.301488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.308372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 441/867] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:51:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:57.314284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:57.413721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6689cb4-4c87-4e43-8726-f0df0856ca4e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.448188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.448984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.449333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.449678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.450597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:57.450852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3d48-8f6f-41a4-8d0c-e4a01d8c6185 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.450956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.452502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.466943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 427/868] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:57.473342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:57.494820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.495999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.496419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.496892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.498691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:57.499429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.500969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563c531-a0c9-45c3-aeb1-4a91bb40ccb7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.508998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 442/869] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:51:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:57.617999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b05abe-5aa6-4741-a50d-823912c2d732 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:57.657246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:57.658000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:57.658288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:57.658566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:57.659414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=ad9df8bc03b54ac5bc828e3343158371) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:51:57.660382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:57.661896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a031b-205e-4e24-ac04-3d40be3efc32 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:57.669070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 428/870] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:51:57 2022] GET /identity/v3/role_assignments?user.id=ad9df8bc03b54ac5bc828e3343158371&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:51:59.241866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457983f7-18f5-4134-adef-1f4db11d289a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.242515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457983f7-18f5-4134-adef-1f4db11d289a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.242515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457983f7-18f5-4134-adef-1f4db11d289a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.244478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 443/871] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:59.249947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d618-4f61-4d57-959d-3bd4bef8b7e4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.250403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d618-4f61-4d57-959d-3bd4bef8b7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.250552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91d618-4f61-4d57-959d-3bd4bef8b7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.268320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0b91d618-4f61-4d57-959d-3bd4bef8b7e4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:59.270101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0b91d618-4f61-4d57-959d-3bd4bef8b7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:59.339083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 429/872] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:51:59.362264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457983f7-18f5-4134-adef-1f4db11d289a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:59.474860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457983f7-18f5-4134-adef-1f4db11d289a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:51:59.509360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb65e2-7490-455d-870d-d06209427db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:51:59.509960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb65e2-7490-455d-870d-d06209427db7 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.510280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb65e2-7490-455d-870d-d06209427db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.510559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb65e2-7490-455d-870d-d06209427db7 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.511314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb65e2-7490-455d-870d-d06209427db7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:51:59.512717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb65e2-7490-455d-870d-d06209427db7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:51:59.586752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 444/873] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:51:59 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:51:59.762323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762124cd-679e-41f6-86e5-247001239a87 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.762512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762124cd-679e-41f6-86e5-247001239a87 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.762776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762124cd-679e-41f6-86e5-247001239a87 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.764884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 430/874] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:51:59.770639 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.771744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.771744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.788483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:59.789726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:59.879737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe88f5-d1ad-47cb-a938-1a53d9dda7b9 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.880116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe88f5-d1ad-47cb-a938-1a53d9dda7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.880409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe88f5-d1ad-47cb-a938-1a53d9dda7b9 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.882596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 431/875] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:51:59.887271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:51:59.887559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:51:59.887850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:51:59.898042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 445/876] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:51:59.905221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:51:59.906474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:51:59.920093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:51:59.974710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 432/877] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:51:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:51:59.997625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.018763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78f98d-6fe5-4b5f-9981-f463e4b8092d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.053522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.054407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.054696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.054972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.055625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:00.057050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:00.068360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-b7be690a-a2df-49fd-9f6c-cb27b2a09343 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 26 13:52:00.069672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 446/878] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:51:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:00.071243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef826-be89-4fc8-9921-77b173454743 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.071243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef826-be89-4fc8-9921-77b173454743 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.071436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ef826-be89-4fc8-9921-77b173454743 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.073075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 447/879] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:00.077672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef826-be89-4fc8-9921-77b173454743 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.095103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e947f-d67f-4742-8cfb-807b80c20c51 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.127734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.128704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.129200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.129676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.130668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:00.132285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:00.175953 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ef826-be89-4fc8-9921-77b173454743 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.207174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.207828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.208113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.208389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.209087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:00.209391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:00.210774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa2cb7-2471-4269-9b98-ff7059be26b2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:00.215265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 448/880] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:00.216213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.216502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.216781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.232711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:00.233882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:00.242318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 433/881] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:51:59 2022] POST /identity/v3/services => generated 269 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:52:00.242318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.312926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 449/882] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:00.336266 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.355081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca83a3-a685-4ef5-8878-0afd84bf034a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.392078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.392771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.393217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.393621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.395029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:00.395377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:00.397652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:00.404725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 434/883] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:00.463506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9da96c-da3e-4750-a70a-9d67e9714302 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.501692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.502822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.503254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.503736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.515662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:00.524076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 26 13:52:00.525924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 450/884] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 26 13:52:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:00.534067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.637563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f826d-b2e9-4410-b1fb-1c7d88179e2a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.672386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.673312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.673731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.674194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.675066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:00.675558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:00.677068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:00.689851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 435/885] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:52:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:00.691456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.799627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99b25e-3db0-4428-98a2-dd3501ea8c75 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:00.834610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:00.835404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:00.835694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:00.835976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:00.847359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:00.848803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:00.864856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:00.866338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 451/886] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:00.871968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:00.969637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca2b09-f8e4-409e-a67d-013eb3e96c0c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:01.002068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:01.003061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.004115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.004620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.005520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:01.006139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:01.007741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:01.024436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 436/887] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:01.026069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:01.130602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e8f49-0cc2-4443-b68b-32917b9f8be1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:01.164242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:01.165052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.165338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.165616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.173353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:01.174829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:01.189436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 26 13:52:01.191571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 452/888] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:52:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:01.197143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:01.296930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed1476-04f2-4cf8-ab96-239f1d34a736 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:01.330494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:01.331217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.331529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.331843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.332681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:01.332988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:01.334451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:01.352062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 437/889] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 26 13:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:01.357645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:01.459202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb9de4-a67c-44d4-9ad8-1df602981df0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:01.494390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:01.495066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.495351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.495616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.565386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:01.566814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:01.672602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 453/890] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:01.674126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:01.774319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b735b-3c8d-4117-be00-e2a8afcb2253 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:01.807379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:01.808179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.808460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.808733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.819679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:01.821073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:01.843020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-61e93c26-0de8-4389-9f20-9d8eb595d5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:01.843020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 438/891] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:01.847893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:01.956218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33cd1f-0003-44ae-a911-bdd2b2aa7f58 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:01.973810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6735c2-1fa3-48a8-b5ef-ea7ece31bbf8 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.974150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6735c2-1fa3-48a8-b5ef-ea7ece31bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.974422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6735c2-1fa3-48a8-b5ef-ea7ece31bbf8 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.976450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 439/892] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:01.981273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.981561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.981836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.992524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:01.993192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:01.993911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:01.994241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:01.994978 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:01.995442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:01.996938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.000040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:02.001318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:02.010446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 454/893] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:02.017474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.089103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 440/894] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:02.112117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.119403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d0033-ba23-4653-8b3f-cef5e15cb3e6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.154889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.155742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.156024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.156297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.163825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.165325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.179816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:02.182022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 455/895] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:02.189351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.244740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a18641-ea41-435e-9a0b-12ea1546bce9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.290820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.292135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.293527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.294115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.294995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.296584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.313376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 26 13:52:02.315600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 441/896] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:02.323614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.336910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6c89-88c0-425d-978a-3446661bc8a9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.390190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.392246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.393032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.393515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.395205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:02.395986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.397632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.415136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 456/897] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:02.420996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.451561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0b37-2a02-406d-85d3-cca4daa0c896 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.495895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.496986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.497544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.498077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.499004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:02.499520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.501104 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.510090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 442/898] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:02.512542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.551947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd183b6-9c0a-43d1-8f07-385749c09af6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.593891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.594587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.594877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.595159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.596377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] RBAC: Adding query filter params (role.id=28ce3c4c070c42dcb0cdcf2d8768acee, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=ad9df8bc03b54ac5bc828e3343158371) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:02.596693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.599288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.606385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 457/899] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/role_assignments?user.id=ad9df8bc03b54ac5bc828e3343158371&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=28ce3c4c070c42dcb0cdcf2d8768acee => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:02.623570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ec4eb-6b58-4025-93a1-c93ae1064ed1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.662574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.663761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.664195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.664668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.665537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:02.666008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.667671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd4dd-558e-40db-ad58-8392380dbab6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.674077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 443/900] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:02.683370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.735781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9973b-e369-41cb-b6b6-d9ed6ba99903 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.736323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9973b-e369-41cb-b6b6-d9ed6ba99903 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.736323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9973b-e369-41cb-b6b6-d9ed6ba99903 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.738498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 444/901] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:02.743955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab50d2-c4aa-4ecb-8c8a-560abe3fb6cf None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.744241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab50d2-c4aa-4ecb-8c8a-560abe3fb6cf None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.744518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab50d2-c4aa-4ecb-8c8a-560abe3fb6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.762390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-87ab50d2-c4aa-4ecb-8c8a-560abe3fb6cf None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:02.764049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-87ab50d2-c4aa-4ecb-8c8a-560abe3fb6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:02.804267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21211cd9-cc68-4af7-8475-499156eb6338 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.835275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 445/902] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:02.836818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2eba-c242-41b0-88bf-b1db44ae38a2 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.837249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2eba-c242-41b0-88bf-b1db44ae38a2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.837666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d2eba-c242-41b0-88bf-b1db44ae38a2 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.840106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 446/903] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:02.841499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.843710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.843710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.843710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.844211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] RBAC: Adding query filter params (interface=public, service_id=30d2d24ade154740a86f8d0f5181e1a6, region_id=RegionOne) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:02.844211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.845532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:02.846121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.846603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.847671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.852831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 458/904] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/endpoints?service_id=30d2d24ade154740a86f8d0f5181e1a6&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:02.858084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.867977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:02.869157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:02.933822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 447/905] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:02.939158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:02.960007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a2681-c0d6-4dc3-8172-3c0c6c9923bb None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:02.992620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:02.993285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:02.993568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:02.993845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:02.994563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:02.995932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.001376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 459/906] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/services => generated 1268 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 13:52:03.004462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:03.066733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b17ba8-c723-49c5-b3be-0a4c7a3e836a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:03.109612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:03.110651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:03.111038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:03.111592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:03.112170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:03.113754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.126588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 26 13:52:03.133260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 448/907] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Apr 26 13:52:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:03.134416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:03.137697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d8a5a-4d74-4171-bde5-ffe8d9c66196 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:03.182982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:03.183945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:03.184403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:03.184686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:03.185413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:03.186853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.239691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a111261b-3a98-4a0e-bc80-8fc29a2f22c1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:03.250067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 460/908] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:52:03 2022] POST /identity/v3/services => generated 241 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:03.291574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:03.292328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:03.292617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:03.292895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:03.293670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:03.293997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:03.295494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.301992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 449/909] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:03.307716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:03.425993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61f665-e692-4a9b-9f28-c9bd923c826d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:03.459465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:03.460134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:03.460422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:03.460701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:03.461415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:03.461724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:03.463755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.470752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 461/910] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:03.476078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:03.584284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c68b8-3525-4672-9fe1-4ac2009c379f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:03.617897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:03.618881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:03.619374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:03.619832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:03.620821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] RBAC: Adding query filter params (interface=public, service_id=37f0f7c2352142708a855f4156a99293, region_id=RegionOne) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:03.621313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:03.622910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf85d0-3bc7-41a4-bdb2-25d96f2e4807 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.629116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 450/911] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:52:03 2022] GET /identity/v3/endpoints?service_id=37f0f7c2352142708a855f4156a99293&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:03.634365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:03.737265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50842b5-a6a9-4562-916f-14f0e9147e1c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:03.771710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb7ccf-e67f-44a3-b39a-3ad55ae01b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:03.772400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7ccf-e67f-44a3-b39a-3ad55ae01b6d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:03.772689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7ccf-e67f-44a3-b39a-3ad55ae01b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:03.772970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb7ccf-e67f-44a3-b39a-3ad55ae01b6d None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:03.773678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7ccf-e67f-44a3-b39a-3ad55ae01b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:03.775105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb7ccf-e67f-44a3-b39a-3ad55ae01b6d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:03.781926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 462/912] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:52:03 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 13:52:04.954607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f1eb-eeb1-48d7-85a1-654a45a85d94 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:04.955125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f1eb-eeb1-48d7-85a1-654a45a85d94 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:04.955232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0f1eb-eeb1-48d7-85a1-654a45a85d94 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:04.957256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 451/913] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:04.962452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:04.962895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:04.963093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:04.981367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:04.982641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:05.052263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 463/914] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:05.075270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f1eb-eeb1-48d7-85a1-654a45a85d94 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.177533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0f1eb-eeb1-48d7-85a1-654a45a85d94 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.211110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b3441-dee7-4dbe-a706-effa19150b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.211838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3441-dee7-4dbe-a706-effa19150b29 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.212116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3441-dee7-4dbe-a706-effa19150b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.212385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b3441-dee7-4dbe-a706-effa19150b29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.223639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b3441-dee7-4dbe-a706-effa19150b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:05.231307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-b00b3441-dee7-4dbe-a706-effa19150b29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 26 13:52:05.232850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 452/915] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:05.238971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.341500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5b3ce-f911-4b79-8e98-fb903361b69a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.341835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17359981-74ba-4ed8-ac24-78d6806baa5a None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.342126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17359981-74ba-4ed8-ac24-78d6806baa5a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.342404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17359981-74ba-4ed8-ac24-78d6806baa5a None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.348668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 453/916] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:05.350257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.350546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.350822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.367869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:05.369063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:05.377171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.377847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.378190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.378471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.379220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:05.379532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:05.380900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:05.389230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 464/917] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:05.394769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.449788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 454/918] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:05.472740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.513779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c27c8-717f-465d-8e85-7b819c98e8d7 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.547277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.548350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.548787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.549201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.560690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:05.562353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:05.579040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:05.580757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 465/919] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:05.583516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8a8db-423b-4dbc-a16f-68bb2222e1ff None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.589997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.621485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.622600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.623060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.623514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.624330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:05.625845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:05.637232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 26 13:52:05.638948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 455/920] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:05.645178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.695375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66067456-ee9b-4512-a653-cae5d2081d5d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.728916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.729891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.730358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.730630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.731358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:05.731665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:05.733024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f05c6-59c4-4fd7-9ac9-c7c200333e7e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:05.742333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1fc0a-d051-4b15-9126-060c4f436139 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.744636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 466/921] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:05.745963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5c63-55b0-4675-92fd-f066fc3f46db None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.746287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5c63-55b0-4675-92fd-f066fc3f46db None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.746564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed5c63-55b0-4675-92fd-f066fc3f46db None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.748366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 467/922] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:05.753133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5c63-55b0-4675-92fd-f066fc3f46db None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.781932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.782946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.783234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.783514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.784250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:05.785159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:05.786620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171aa5c9-b81a-4c1d-9e3b-52ec95865d7d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:05.792120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 456/923] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:05.793549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.794003 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.794422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.811200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:05.812622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:05.857360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed5c63-55b0-4675-92fd-f066fc3f46db None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:05.879254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 457/924] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:05.880636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.890950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:05.891757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:05.892033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:05.892312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:05.899919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:05.901345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:05.916128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 26 13:52:05.917576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 468/925] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:05.918368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:05.990642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f485fd-0a66-4f92-b8ee-aceac985a068 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.013921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92def06-fcaf-4b05-8ae8-e1963af9cb27 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.026262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.026931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.027215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.027490 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.028200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.028505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.029884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.039751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 458/926] 10.222.0.23 () {56 vars in 1114 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.039751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.052632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.053440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.053724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.054024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.054686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.056037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.067984 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 26 13:52:06.073830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 469/927] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:06.073830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.130946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc48268-f78f-4474-973a-8d8a9e71754d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.163911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.164574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.164857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.165132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.165958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.166295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.167711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.167820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549dbe7-7b1a-43b7-949d-4a96d663b501 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.184477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 459/928] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.185298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.207305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993f373-97b1-436e-9b73-8c3b0420feef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.207968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f373-97b1-436e-9b73-8c3b0420feef None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.208257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f373-97b1-436e-9b73-8c3b0420feef None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.208534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993f373-97b1-436e-9b73-8c3b0420feef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.209275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993f373-97b1-436e-9b73-8c3b0420feef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.210705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993f373-97b1-436e-9b73-8c3b0420feef None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.280365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8d36-4bcd-46d7-846b-1678c36e1b7f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.287832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 470/929] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:52:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:06.289190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a4e5-cdf2-47cb-86ec-19548aa3dc9d None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.289480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a4e5-cdf2-47cb-86ec-19548aa3dc9d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.289765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206a4e5-cdf2-47cb-86ec-19548aa3dc9d None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.291530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 471/930] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:06.292302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a4e5-cdf2-47cb-86ec-19548aa3dc9d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.331996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.332681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.332966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.333285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.334019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.334329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.335731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f948653-fa8a-46f9-b92a-c7b1f8e34bae None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.346029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 460/931] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.346029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.346029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.346029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.364455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:06.365684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:06.418884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206a4e5-cdf2-47cb-86ec-19548aa3dc9d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.438035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 461/932] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:06.438035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.483351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.484153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.484441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.484723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.498545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.500101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.519396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:06.520772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 472/933] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:06.521472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.556169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee416b9-c6ce-4636-89a1-2b0e9c1d6a54 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.590033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.590706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.590991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.591270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.591976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.592285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.593646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.603920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 462/934] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.603920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.629780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acaafb-7a16-4484-9ca5-dd36ad1bd423 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.664487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.665293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.665575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.665847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.666533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.667884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.679106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 26 13:52:06.680455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 473/935] 10.222.0.23 () {56 vars in 1132 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:06.681052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.696431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4258082-5f90-401b-8169-951ddb306a6b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.731072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.731742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.732020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.737064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.737064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.737064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.737064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.747020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 463/936] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.747928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.794146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3877c7-3b6d-4e84-93c3-58faf293e53c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.829055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.829809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.830129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.830428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.831268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] RBAC: Adding query filter params (interface=public, service_id=aaee8b3cd0e8485792f7bf64721e099e, region_id=RegionOne) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.832092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.833541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.838347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 474/937] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/endpoints?service_id=aaee8b3cd0e8485792f7bf64721e099e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.839104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.852632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac106322-882d-4c5b-9824-ead68d55c8f3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.893381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.894940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.895364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.895773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.896876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:06.897328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.898796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:06.910391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 464/938] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:06.911191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:06.947383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39c121-d5f1-4621-9e55-fc9ef0ae02e5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:06.980246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:06.981030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:06.981312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:06.981585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:06.988181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:06.989610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:07.003584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:07.004812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 475/939] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:07.005544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:07.016718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da728f6-ccba-4417-91de-e000a1fa7c13 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:07.050053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:07.050937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:07.051361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:07.051795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:07.052618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:07.054131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:07.060126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 465/940] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:52:06 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 13:52:07.061069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:07.127006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febf0ee-a249-4a25-9eaf-d80059e4acb6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:07.191386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92036570-1e1e-4868-9dba-eef1c5aeaabd None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:07.191809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:07.192498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:07.192781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:07.193057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:07.193798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:07.194348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:07.196797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:07.203050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 476/941] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:07.209394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:07.240304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:07.241344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:07.241781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:07.242235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:07.243282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:07.243849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:07.246149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:07.265945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 466/942] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:07.267399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:07.354438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4578111-f06d-4692-bb83-1eaef132b10a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:07.386465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba3e1-b816-47ef-83b3-46b4833b286b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:07.392642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55091f-8dc5-4804-91a8-57213450864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:07.393401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55091f-8dc5-4804-91a8-57213450864c None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:07.394308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55091f-8dc5-4804-91a8-57213450864c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:07.394654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55091f-8dc5-4804-91a8-57213450864c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:07.395598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55091f-8dc5-4804-91a8-57213450864c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:07.397053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55091f-8dc5-4804-91a8-57213450864c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:07.425793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0740f-9cac-4e84-8b9d-32892a9e4290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:07.426761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0740f-9cac-4e84-8b9d-32892a9e4290 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:07.427040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0740f-9cac-4e84-8b9d-32892a9e4290 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:07.427354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0740f-9cac-4e84-8b9d-32892a9e4290 None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/ad9df8bc03b54ac5bc828e3343158371/roles/28ce3c4c070c42dcb0cdcf2d8768acee` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:07.429625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0740f-9cac-4e84-8b9d-32892a9e4290 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=ad9df8bc03b54ac5bc828e3343158371, role_id=28ce3c4c070c42dcb0cdcf2d8768acee)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:07.431140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0740f-9cac-4e84-8b9d-32892a9e4290 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:07.513996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 477/943] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:52:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:07.556487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 467/944] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:52:07 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/ad9df8bc03b54ac5bc828e3343158371/roles/28ce3c4c070c42dcb0cdcf2d8768acee => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:52:08.711241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a48c8-27ac-48db-8655-c221d76de8b8 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:08.711744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a48c8-27ac-48db-8655-c221d76de8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:08.711744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a48c8-27ac-48db-8655-c221d76de8b8 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:08.713835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 478/945] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:08.720618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:08.720618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:08.720618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:08.739385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:08.740945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:08.818066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 468/946] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:08.838071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a48c8-27ac-48db-8655-c221d76de8b8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:08.939341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a48c8-27ac-48db-8655-c221d76de8b8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:08.974140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:08.975151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:08.975645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:08.976130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:08.977035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:08.978678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:08.980259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.common [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 26 13:52:09.033682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.sql.core [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 26 13:52:09.033682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 26 13:52:09.033682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [parameters: {'id': 'b8acbe000abd46189dbbe707b85f7702', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 26 13:52:09.033682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80041) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 26 13:52:09.041886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8acbe000abd46189dbbe707b85f7702.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b8acbe000abd46189dbbe707b85f7702. Apr 26 13:52:09.047568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 479/947] 10.222.0.23 () {60 vars in 1140 bytes} [Tue Apr 26 13:52:08 2022] POST /identity/v3/projects => generated 262 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:09.050538 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:09.155110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9254733-f2f7-47d3-8f22-9c917e913796 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:09.191773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:09.192567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.192846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.193115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.199838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:09.201354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:09.214253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-daabf075-21d2-4042-bcce-cd5fea50fb0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:09.215760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 469/948] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:09.222357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:09.326419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c13a4-146a-496e-ab0c-8a73af29440f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:09.361060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:09.362170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.363249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.363756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.364715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:09.365220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:09.367109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b11b1-e2c4-4f84-85ae-ad9dfabd1781 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:09.391666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 480/949] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:09.474604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166429a-2d72-4767-bb02-c8939be1c958 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.474912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166429a-2d72-4767-bb02-c8939be1c958 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.475168 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166429a-2d72-4767-bb02-c8939be1c958 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.477292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 470/950] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:09.482661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.482951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.483231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.505864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:09.507722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:09.588975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 481/951] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:09.612800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166429a-2d72-4767-bb02-c8939be1c958 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:09.715051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166429a-2d72-4767-bb02-c8939be1c958 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:09.749080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:09.749896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.750214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.750489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.751140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:09.752570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:09.765141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-851b3476-0210-41c6-84a9-421121aaee51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 26 13:52:09.766722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 471/952] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:09.773164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:09.874690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0199672-0fbd-4ad7-abe9-4861982ed019 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:09.898634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895cb3c-87f8-4c22-8241-25595e6b5ff8 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.898982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895cb3c-87f8-4c22-8241-25595e6b5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.899204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895cb3c-87f8-4c22-8241-25595e6b5ff8 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.901253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 472/953] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:09.906154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824baf-c12e-4203-9289-b8c4e957d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.906450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824baf-c12e-4203-9289-b8c4e957d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.906733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824baf-c12e-4203-9289-b8c4e957d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.911122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:09.911986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.912275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.913634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.914556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:09.914871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:09.916237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:09.922400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 482/954] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:09.923976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-d7824baf-c12e-4203-9289-b8c4e957d0e6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:09.925200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-d7824baf-c12e-4203-9289-b8c4e957d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:09.929049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:09.991681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 473/955] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:09.993002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58465e-ef8f-41fc-b692-a13a4912cc22 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:09.993286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58465e-ef8f-41fc-b692-a13a4912cc22 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:09.993562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58465e-ef8f-41fc-b692-a13a4912cc22 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:09.995523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 474/956] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:10.000489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e344711-a964-4064-aa08-695d36412ced None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.000774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e344711-a964-4064-aa08-695d36412ced None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.001045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e344711-a964-4064-aa08-695d36412ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.021792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6e344711-a964-4064-aa08-695d36412ced None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:10.022999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6e344711-a964-4064-aa08-695d36412ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:10.035887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf86d6d-dea0-40c8-9474-0111772e02bf None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.069189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.069844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.070161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.070442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.071152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:10.071459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.072825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.077691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 483/957] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:10.078328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.110098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 475/958] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:10.111116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e344711-a964-4064-aa08-695d36412ced None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.180583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb64aae-b5b0-471d-bd38-049a9550818d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.211213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e344711-a964-4064-aa08-695d36412ced None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.215593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.216383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.216675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.216954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.217613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.219050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.229947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 26 13:52:10.231452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 484/959] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:10.232294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.246808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.247508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.247794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.248061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.248793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.250187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.330126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d997a3-72a6-446b-b13a-b33edc73d78f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.354611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 476/960] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:52:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:10.355576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.370182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.371297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.371723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.372142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.385884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:10.394468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 26 13:52:10.402616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 485/961] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:10.403817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.491136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4f25-73ff-445e-81a6-9870867958e8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.528620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.529334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.529615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.529950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.530641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:10.530945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.532361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.532957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bba90-dbf4-443a-9592-4a6715af278e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.542963 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 477/962] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:10.544547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.580616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.581873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.582189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.582494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.583488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:10.583592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.584902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.594119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 486/963] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:10.602164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.658169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069e29e-30c9-4c25-b4a8-2c10756137ee None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.700771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.701472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.701824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.702197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.703050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:10.703421 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.704997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.710647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 478/964] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:10.743039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ba9c0-6bed-44cb-a4cb-3466fef6c631 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.780319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.781291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.781574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.781849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.794842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.796412 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.814635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:10.816805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 487/965] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:10.823136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:10.929020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da92a10-f24c-4d56-b18b-3daad75ad1c7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:10.969016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:10.969916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:10.970430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:10.970910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:10.972721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:10.973221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:10.975598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:10.989856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 479/966] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:10.995436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:11.102162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1257bb-72ea-4462-a0cd-314bdea28e4c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:11.136993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:11.138192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.138675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.139130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.147296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:11.150204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:11.165193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 26 13:52:11.166994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 488/967] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:52:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:11.172683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:11.269063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd27e-5ae0-4b45-94ae-afa14d6ef2ad None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:11.306083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:11.307091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.307576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.308024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.309016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:11.309494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:11.311098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:11.329312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 480/968] 10.222.0.23 () {56 vars in 1149 bytes} [Tue Apr 26 13:52:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:11.335531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:11.435449 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e7544-0ca4-45bf-b81b-31f6e483e8fd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:11.475042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbf26-72f7-492b-adc9-fa9ed225ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:11.475685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbf26-72f7-492b-adc9-fa9ed225ed3c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.475966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbf26-72f7-492b-adc9-fa9ed225ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.476301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbf26-72f7-492b-adc9-fa9ed225ed3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.544084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbf26-72f7-492b-adc9-fa9ed225ed3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:11.545453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbf26-72f7-492b-adc9-fa9ed225ed3c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:11.650307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 489/969] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:11 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:11.651828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:11.749627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b60499-1dc5-4db8-afdb-baa1a5ac265d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:11.783060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:11.783854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.784689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.784984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.795245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:11.796621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:11.809077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879083a-c56c-4449-a735-7b7e07a8d737 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.809582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879083a-c56c-4449-a735-7b7e07a8d737 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.809661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879083a-c56c-4449-a735-7b7e07a8d737 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.813323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:11.814071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 490/970] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:11.814809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 481/971] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:11.816876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.817171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.817455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.825999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:11.836155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:11.837441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:11.905740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 491/972] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:11.924533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009b43-5b61-4435-877c-1446692760c1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:11.930793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:11.960787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:11.961488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:11.961771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:11.962066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:11.962785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:11.963085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:11.964523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:11.976882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 482/973] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:11.982257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:12.033287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5df0b-2a4d-4618-adaa-2b190ad6b454 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:12.068547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:12.069263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.069622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.069990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.070774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:12.072288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:12.081493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea476c-63ae-4812-97c2-3659c1d50605 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:12.115498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:12.116290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.116466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.sql.core [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 26 13:52:12.116466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 26 13:52:12.116466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [parameters: {'user_id': '273a5a493a90430986f1ed51f726b682', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 26 13:52:12.116466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80041) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 26 13:52:12.116966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.116966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.123168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 26 13:52:12.123434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:12.124874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:12.125062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 492/974] 10.222.0.23 () {60 vars in 1131 bytes} [Tue Apr 26 13:52:11 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:12.130685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:12.139635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:12.145595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 483/975] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:12.146623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:12.248309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b38fcc-d89a-4cb9-b7c1-8439f8d21b61 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:12.261855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbe8bc-be6b-4020-a494-2e87c5075a29 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:12.282403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:12.283335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.283680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.284013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.292353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:12.294208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:12.302378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:12.303096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.303384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.303659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.304446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:12.304750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:12.306200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:12.309259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 26 13:52:12.310914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 493/976] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:12.317451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:12.323795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 484/977] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:12.337350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:12.435045 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527342-f31f-492c-9608-e2a0068f9988 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:12.450005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9350740-22ff-4ce9-8896-996f3a33daa7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:12.477543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:12.478618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.478975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.479350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.480653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:12.481037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:12.483035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf9fc4-9380-49a0-b28e-868739f5ecfc None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:12.485670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:12.486553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.487006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.487557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.488557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] RBAC: Adding query filter params (role.id=28ce3c4c070c42dcb0cdcf2d8768acee, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=ad9df8bc03b54ac5bc828e3343158371) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:12.489037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:12.490651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c33cf-6c3e-4a36-a00b-584dda860683 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:12.502074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 485/978] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:12 2022] GET /identity/v3/role_assignments?user.id=ad9df8bc03b54ac5bc828e3343158371&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=28ce3c4c070c42dcb0cdcf2d8768acee => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:12.534751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 494/979] 10.222.0.23 () {56 vars in 1101 bytes} [Tue Apr 26 13:52:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:12.776627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f7777-b045-49c8-a4c4-4491e3c69707 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.776969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f7777-b045-49c8-a4c4-4491e3c69707 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.777147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f7777-b045-49c8-a4c4-4491e3c69707 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.779174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 486/980] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:12.785640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:12.785989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:12.786258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:12.809165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:12.810751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:12.881491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 495/981] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:12.904587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f7777-b045-49c8-a4c4-4491e3c69707 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:13.000485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f7777-b045-49c8-a4c4-4491e3c69707 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:13.033249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:13.033990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.034323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.034594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.035239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:13.036597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:13.047803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-5857325b-7d12-4a50-a9ef-6035994c07b5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 26 13:52:13.049153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 487/982] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:13.054989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:13.148712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e218b7-0af9-4887-8088-380b75cfcf75 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:13.179576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df17c5-baab-49f7-9d25-f4ce5d170c05 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.179876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df17c5-baab-49f7-9d25-f4ce5d170c05 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.180139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df17c5-baab-49f7-9d25-f4ce5d170c05 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.181032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:13.181691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.184901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.185031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 488/983] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:13.185131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.185131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:13.185131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:13.185131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:13.186896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.187253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.187602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.189726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 496/984] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:13.195788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:13.207218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:13.208393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:13.279116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 489/985] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:13.293158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4364a26-282a-441f-a482-cae1a978ac76 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:13.302086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:13.329140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:13.329798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.330120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.330398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.331128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:13.331433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:13.332794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:13.342423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 497/986] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:13.343061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:13.399982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e4146-6bef-419a-a83b-391a7347346b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:13.439206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d10df-99a4-43c5-b743-12fae1d57f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:13.439811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d10df-99a4-43c5-b743-12fae1d57f4d None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.440092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d10df-99a4-43c5-b743-12fae1d57f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.440426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d10df-99a4-43c5-b743-12fae1d57f4d None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.442855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d10df-99a4-43c5-b743-12fae1d57f4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:13.444245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d10df-99a4-43c5-b743-12fae1d57f4d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:13.453598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646b018-b739-4207-ade7-dd44c9001049 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:13.486168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:13.486827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.487113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.487970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.488773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] RBAC: Adding query filter params (interface=admin, service_id=aaee8b3cd0e8485792f7bf64721e099e, region_id=RegionOne) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:13.489115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:13.490463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:13.495537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 498/987] 10.222.0.23 () {56 vars in 1249 bytes} [Tue Apr 26 13:52:13 2022] GET /identity/v3/endpoints?service_id=aaee8b3cd0e8485792f7bf64721e099e&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:13.500656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:13.526332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 490/988] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:52:13 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:52:13.603334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f2daf-3f61-415d-94c7-320dee16b3a0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:13.645569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13fc3c-e4e6-47eb-960c-1c0cf900dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:13.646328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fc3c-e4e6-47eb-960c-1c0cf900dce2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:13.646609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fc3c-e4e6-47eb-960c-1c0cf900dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:13.646877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13fc3c-e4e6-47eb-960c-1c0cf900dce2 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:13.647566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13fc3c-e4e6-47eb-960c-1c0cf900dce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:13.648929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13fc3c-e4e6-47eb-960c-1c0cf900dce2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:13.662004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 499/989] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:52:13 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 13:52:14.896960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c6f61-92a0-40fd-afdf-f2c7f2e79bff None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:14.897470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c6f61-92a0-40fd-afdf-f2c7f2e79bff None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:14.897548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c6f61-92a0-40fd-afdf-f2c7f2e79bff None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:14.899353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 491/990] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:14.904406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:14.904822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:14.905026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:14.922356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:14.923557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:14.986726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 500/991] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:15.011483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c6f61-92a0-40fd-afdf-f2c7f2e79bff None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:15.125432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c6f61-92a0-40fd-afdf-f2c7f2e79bff None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:15.156795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:15.157503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.157778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.158071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] PATH_INFO: `/v3/services/image` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.158710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:15.160603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:15.171232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 26 13:52:15.172393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 492/992] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Apr 26 13:52:15 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:15.179190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:15.270928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50115926-7d2c-4206-8f3c-abc809bfa592 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:15.303732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:15.304397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.304678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.304947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.305651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] RBAC: Adding query filter params (name=image) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:15.305956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:15.307356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6986d08-a2c3-4616-9a1a-a4c333b370fe None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:15.312319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 501/993] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:15.317739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:15.413041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b6755b-b12b-4fe6-92fb-d86328e15cae None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:15.446357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:15.447031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.447315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.447587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.448286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] RBAC: Adding query filter params (type=image) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:15.448589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:15.449948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7f4c9-41b7-4d7e-8537-5681218de65b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:15.462324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 493/994] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:15.870199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af82ff-823c-4439-be96-17050ddc8050 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.870572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af82ff-823c-4439-be96-17050ddc8050 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.870766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af82ff-823c-4439-be96-17050ddc8050 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.872693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 502/995] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:15.877562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4213e-8a41-40ca-8391-e59c64455187 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.878411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4213e-8a41-40ca-8391-e59c64455187 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.878691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4213e-8a41-40ca-8391-e59c64455187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.895744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4df4213e-8a41-40ca-8391-e59c64455187 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:15.896913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4df4213e-8a41-40ca-8391-e59c64455187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:15.961489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 494/996] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:15.962780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5e2a-f940-48a5-940b-56732e3e856a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.963142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5e2a-f940-48a5-940b-56732e3e856a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.963340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef5e2a-f940-48a5-940b-56732e3e856a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.965300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 503/997] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:15.970089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:15.970618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:15.971048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:15.984299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5e2a-f940-48a5-940b-56732e3e856a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:15.987651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:15.988850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:16.052048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 495/998] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:16.075011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.083321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef5e2a-f940-48a5-940b-56732e3e856a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.117579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.118401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.118687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.118972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.119628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.121048 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.132312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 26 13:52:16.133638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 504/999] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:16.139086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.170115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1076281-0078-4c7d-8c32-b5b535696b64 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.204284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.205092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.205368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.205646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.206348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.207882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.218915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 26 13:52:16.220086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 496/1000] 10.222.0.23 () {56 vars in 1126 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:16.226260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.240645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9edb2-1ac4-4ba4-beb3-f04ccf6643cc None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.274627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.275287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.275572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.275850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.276587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] RBAC: Adding query filter params (name=compute) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:16.276897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.278360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.283158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 505/1001] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:16.288677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.327437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa1779-767a-4e44-b56e-8b921be86703 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.359722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.360382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.360660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.360931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.361621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:16.361923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.363846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.368592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 497/1002] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:16.374071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.389424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898b839-d369-4e85-b432-901ffdfbbfec None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.422011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.422698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.422979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.423257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.423960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:16.424262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.426361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.434263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 506/1003] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:16.438878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.482305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30d2d-9bac-4574-8510-239ddfd58cd6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.515547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.516239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.516487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.516758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.520068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:16.520068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.520068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.524249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 498/1004] 10.222.0.23 () {56 vars in 1122 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:16.529826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.542131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912064b-7a74-457c-8b11-4adfcc01b938 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.576211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.576892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.577179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.577450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.578309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] RBAC: Adding query filter params (interface=public, service_id=99a7aa0e5bec4163b3fe5b3fca54e8ee, region_id=RegionOne) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:16.578628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.580029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.586334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 507/1005] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/endpoints?service_id=99a7aa0e5bec4163b3fe5b3fca54e8ee&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:16.591585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:16.632008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edde25-2796-4f7f-9792-f91272086f21 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.664473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42050e-28dd-4b10-a888-fab6254cbc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.665415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42050e-28dd-4b10-a888-fab6254cbc04 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.665878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42050e-28dd-4b10-a888-fab6254cbc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.666371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42050e-28dd-4b10-a888-fab6254cbc04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.667284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42050e-28dd-4b10-a888-fab6254cbc04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.668835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42050e-28dd-4b10-a888-fab6254cbc04 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.685002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a75f3e-64ae-4680-9da9-e491a41b7688 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:16.717601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e647b68-5dd5-42d5-9df2-66689bf5ed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:16.718285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e647b68-5dd5-42d5-9df2-66689bf5ed35 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:16.718570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e647b68-5dd5-42d5-9df2-66689bf5ed35 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:16.718845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e647b68-5dd5-42d5-9df2-66689bf5ed35 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:16.719517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e647b68-5dd5-42d5-9df2-66689bf5ed35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:16.720857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e647b68-5dd5-42d5-9df2-66689bf5ed35 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:16.727512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 508/1006] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:52:16 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 13:52:16.783571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 499/1007] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:52:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:17.750051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5028c57-c151-4774-8e95-cb0f91198146 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:17.750544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5028c57-c151-4774-8e95-cb0f91198146 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:17.750544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5028c57-c151-4774-8e95-cb0f91198146 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:17.752378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 509/1008] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:17.757503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1480e-173d-43f1-9b10-968412f77f5e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:17.757925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1480e-173d-43f1-9b10-968412f77f5e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:17.758114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1480e-173d-43f1-9b10-968412f77f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:17.775425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-73a1480e-173d-43f1-9b10-968412f77f5e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:17.776611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-73a1480e-173d-43f1-9b10-968412f77f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:17.847064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 500/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:17 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:17.869662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5028c57-c151-4774-8e95-cb0f91198146 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:17.972244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5028c57-c151-4774-8e95-cb0f91198146 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:18.004610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab31d9c-77b0-4b67-98d0-799899b0d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:18.005196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab31d9c-77b0-4b67-98d0-799899b0d999 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:18.005480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab31d9c-77b0-4b67-98d0-799899b0d999 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:18.005758 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab31d9c-77b0-4b67-98d0-799899b0d999 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:18.006513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab31d9c-77b0-4b67-98d0-799899b0d999 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:18.007884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab31d9c-77b0-4b67-98d0-799899b0d999 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:18.097996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 510/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:52:17 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:19.083777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3ebd8-0815-41b1-93e0-e8515b30ab66 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.084305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3ebd8-0815-41b1-93e0-e8515b30ab66 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.084305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3ebd8-0815-41b1-93e0-e8515b30ab66 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.086403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 501/1011] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:19.091440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.091820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.091988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.108457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:19.109642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:19.113916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d7d5-77a2-45b1-ba0f-e8acee6559a8 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.114230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d7d5-77a2-45b1-ba0f-e8acee6559a8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.114506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008d7d5-77a2-45b1-ba0f-e8acee6559a8 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.116387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 502/1012] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:19.122184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.122467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.122737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.139365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:19.140539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:19.181791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 511/1013] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:19.204038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 503/1014] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:19.204909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:19.228783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:19.303659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362d46-0273-4f5c-a527-bd3c5753992b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:19.323513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651ecf-dcc1-4c6a-b057-622ab673b6d5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:19.336471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:19.337202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.337487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.337754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.338440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:19.339797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:19.350477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 26 13:52:19.351636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 512/1015] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:19.355759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:19.356545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.356825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.357093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.357491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:19.358363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:19.359780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:19.366061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 504/1016] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:19.367712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:19.458591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb24cdc-7690-461f-9ff5-69922c91952c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:19.470015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a962f5-8841-44f8-89a2-b9e23d22663f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:19.492197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:19.492864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.493152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.493434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.494238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:19.494551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:19.495914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:19.500598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 513/1017] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:19.504652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:19.505621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.506106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.506234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:19.506725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.507562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:19.509142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:19.595576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 505/1018] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:52:19 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:52:19.601156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5409d0-11d4-407a-9f6c-3ae294310702 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:19.638623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:19.639304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.639759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.639889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.640647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:19.640958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:19.642378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4a95d-da1a-4290-ae0c-0dad85adf7c4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:19.648696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 514/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Tue Apr 26 13:52:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:19.654184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:19.758408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f7140-cc17-44e1-b0be-4084d34570d1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:19.792697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca01578-9d4a-404b-8980-d978923bc80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:19.793359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01578-9d4a-404b-8980-d978923bc80b None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:19.793640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01578-9d4a-404b-8980-d978923bc80b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:19.793913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca01578-9d4a-404b-8980-d978923bc80b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:19.794668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca01578-9d4a-404b-8980-d978923bc80b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:19.796039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca01578-9d4a-404b-8980-d978923bc80b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:19.869081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 506/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:52:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:52:20.405255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e406b8-7921-4ea5-ac87-c90aae25b905 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:20.405805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e406b8-7921-4ea5-ac87-c90aae25b905 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:20.405805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e406b8-7921-4ea5-ac87-c90aae25b905 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:20.407679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 515/1021] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:20.413004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:20.413380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:20.413570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:20.430084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:20.431303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:20.501275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 507/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:20.524626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e406b8-7921-4ea5-ac87-c90aae25b905 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:20.624539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e406b8-7921-4ea5-ac87-c90aae25b905 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:20.657703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:20.658453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:20.658737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:20.659035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] PATH_INFO: `/v3/services/image` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:20.659687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:20.661036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:20.671877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 26 13:52:20.674122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 516/1023] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Apr 26 13:52:20 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:20.679745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:20.777398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b98ac5-2da4-4da0-9452-a4cd4686353d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:20.810268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:20.810928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:20.811209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:20.811483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:20.812185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] RBAC: Adding query filter params (name=image) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:20.812488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:20.813851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:20.823307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 508/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:20.824509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:20.920858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc315636-a56a-41d0-bd61-342e362db87a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:20.953243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:20.953911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:20.954244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:20.954527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:20.955241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] RBAC: Adding query filter params (type=image) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:20.955553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:20.956942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:20.966246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 517/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:20.967763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:21.063209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7de30-4ba1-4821-b8af-934fede30c54 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:21.097161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:21.097822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:21.098135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:21.098409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:21.099189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] RBAC: Adding query filter params (interface=public, service_id=0593e8a1d20b45078c56583691719bdb, region_id=RegionOne) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:21.099497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:21.100852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3286e8-f3b1-4149-8d07-7035e4b13826 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:21.110073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 509/1026] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:52:20 2022] GET /identity/v3/endpoints?service_id=0593e8a1d20b45078c56583691719bdb&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:21.111626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:21.208674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d8d96d-ed99-4a1e-8513-66d4d5815f99 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:21.239976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab39be-e03d-45a4-b204-f82bdebb6332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:21.240630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab39be-e03d-45a4-b204-f82bdebb6332 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:21.240915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab39be-e03d-45a4-b204-f82bdebb6332 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:21.241190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab39be-e03d-45a4-b204-f82bdebb6332 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:21.241860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab39be-e03d-45a4-b204-f82bdebb6332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:21.243272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab39be-e03d-45a4-b204-f82bdebb6332 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:21.249707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 518/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:52:21 2022] GET /identity/v3/services => generated 1957 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 13:52:21.934220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b40f-40da-47cb-91bc-80bc20c674af None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:21.934784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b40f-40da-47cb-91bc-80bc20c674af None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:21.934784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00b40f-40da-47cb-91bc-80bc20c674af None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:21.936731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 510/1028] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:21.942346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0cb41-7408-4595-a555-96888c9eef13 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:21.942807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0cb41-7408-4595-a555-96888c9eef13 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:21.943166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0cb41-7408-4595-a555-96888c9eef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.083065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6aa0cb41-7408-4595-a555-96888c9eef13 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:22.084262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6aa0cb41-7408-4595-a555-96888c9eef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:22.147881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 519/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:22.172901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b40f-40da-47cb-91bc-80bc20c674af None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:22.231674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca157e48-1e00-418e-8f23-c6af07e19c80 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.231874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca157e48-1e00-418e-8f23-c6af07e19c80 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.232309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca157e48-1e00-418e-8f23-c6af07e19c80 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.234257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 520/1030] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:22.239179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.239649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.239927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.255931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:22.257386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:22.271970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00b40f-40da-47cb-91bc-80bc20c674af None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:22.305589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:22.306419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.306707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.307081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.308159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:22.309815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:22.315839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 511/1031] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:22.317195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:22.330391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 521/1032] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:22.346058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:22.418441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea622805-287e-47ce-a6f6-95d5ccd7a568 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:22.451334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186fbca-dfc5-4435-9093-d1b45c36c721 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:22.452267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:22.452939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.453218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.453493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.454217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:22.455659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:22.484719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:22.485454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.485776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.486072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.496316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:22.503611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 26 13:52:22.504811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 522/1033] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 26 13:52:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:22.510531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:22.561474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 512/1034] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:52:22 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:52:22.628333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54226-8562-46d8-ac9b-00c557bf8cf9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:22.665568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:22.666640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.667106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.667559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.668497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:22.669001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:22.670746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:22.684910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 523/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:52:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:22.686185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:22.788549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29069786-de18-4594-8f13-82a2f9caa89a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:22.822596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:22.823718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:22.824173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:22.824449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:22.835431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:22.836888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:22.853547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:22.854781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 513/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:22.860520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:22.971970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26071-31bd-4907-9d92-f45a772853d6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.003850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.004514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.004794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.005071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.005791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:23.006125 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.007487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.023451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 524/1037] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:23.024732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.118586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90e80a-5492-455f-af3d-8ffbe956faaf None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.149686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.150510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.150789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.151060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.158354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.160396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.175310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:52:23.176975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 514/1038] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:23.182711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.281955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06490304-813a-4c2a-a434-73da3d0e4464 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.313643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.314338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.314622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.315436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.316284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:23.316591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.318001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c9c8c-5d16-4387-9ebe-7d0d93d62461 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.335271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 525/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:23.340653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.444696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eda53f-6c8a-4635-b63b-d428b75e4674 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.476723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.477371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.477664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.477922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.530499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aed95-f0ad-442a-b72f-7d98c70029ac None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.530790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aed95-f0ad-442a-b72f-7d98c70029ac None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.531075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aed95-f0ad-442a-b72f-7d98c70029ac None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.532988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 526/1040] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:23.538016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.538314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.538594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.542382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.543945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.555227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:23.556416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:23.623785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 527/1041] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:23.646345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 515/1042] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:23.647515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.647728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.743460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fba871-e916-4945-8cae-bfe73b22b55f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.757992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76abf9-3851-44fd-a73d-140cdb4b692f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.781608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.782437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.782713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.782975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.792554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.793024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.793785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.794284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.794512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.794964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] PATH_INFO: `/v3/services/image` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.795754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.797669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.809875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 26 13:52:23.811465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:23.811643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 528/1043] 10.222.0.23 () {56 vars in 1105 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:23.812723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 516/1044] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:23.817703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.818409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.914106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a5ee3-b254-4586-b16b-422b131af96f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.914741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ccd6e-49ab-425c-911d-b45680ad9c6b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:23.950288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.950950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.951229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.951503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.952215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:23.952518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.953685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:23.953862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.954374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:23.954660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:23.954936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:23.955666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] RBAC: Adding query filter params (name=image) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:23.955982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:23.957325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:23.966501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 529/1045] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:23.966653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 517/1046] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:23.971076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:23.971732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:24.065217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6dd3f-b029-41b0-acac-7aea0ec58f83 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:24.065838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed670a82-23d9-4298-a454-f3611da02a5b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:24.097308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:24.097598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:24.097985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.098276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.098372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.098550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.098645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.098860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.099255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:24.099558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:24.100907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:24.105452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:24.110337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 530/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:24.110480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:24.111235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:24.120297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:24.121572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 518/1048] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:24.126948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:24.208311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85281-44ad-4e46-8c83-708695b5a2c9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:24.222642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d33000-b4a7-43dc-ae34-07f18f7e3dbb None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:24.241488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4c732-5117-4e5c-b77c-6b7bd781b3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:24.242180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c732-5117-4e5c-b77c-6b7bd781b3ab None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.242468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c732-5117-4e5c-b77c-6b7bd781b3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.242753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4c732-5117-4e5c-b77c-6b7bd781b3ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.243474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c732-5117-4e5c-b77c-6b7bd781b3ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:24.244828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4c732-5117-4e5c-b77c-6b7bd781b3ab None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:24.259167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:24.259827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.260110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.260385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.261164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:24.261473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:24.262932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:24.274852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 519/1049] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:24.280688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:24.360137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 531/1050] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:52:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:24.378107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03294e-123e-4c08-b7b7-ded8e7408bce None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:24.420436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:24.421111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.421394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.421664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.422541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] RBAC: Adding query filter params (role.id=28ce3c4c070c42dcb0cdcf2d8768acee, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=8b647906359a4d8bb2e0cf3098d62967) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:24.422852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:24.424852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854307be-099d-49f0-b1f9-4364fd8f1333 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:24.431360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 520/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:24 2022] GET /identity/v3/role_assignments?user.id=8b647906359a4d8bb2e0cf3098d62967&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=28ce3c4c070c42dcb0cdcf2d8768acee => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:24.935506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445eeb-c1d4-4a1a-9e52-c65e192e168d None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.935829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445eeb-c1d4-4a1a-9e52-c65e192e168d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.936078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445eeb-c1d4-4a1a-9e52-c65e192e168d None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.937901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 532/1052] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:24.943218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:24.943583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:24.943937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:24.961048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:24.962267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:25.024866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 521/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:25.048977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445eeb-c1d4-4a1a-9e52-c65e192e168d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:25.146438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445eeb-c1d4-4a1a-9e52-c65e192e168d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:25.179701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:25.180492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:25.180776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:25.181053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:25.190935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:25.197834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:52:25.199233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 533/1054] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:52:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:25.204981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:25.299790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be530a-4c95-4619-ab86-8ca2609902b2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:25.331970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:25.332634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:25.332917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:25.333191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:25.333925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:25.334262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:25.335628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:25.343426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 522/1055] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:25.349561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:25.451685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47870eb2-f631-489e-b431-617bba88b37f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:25.484867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:25.485740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:25.486055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:25.486385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] PATH_INFO: `/v3/users/c5ea6bb30327432e9fae34e08121518e` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:25.499664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] RBAC: Authorizing `identity:get_user(user_id=c5ea6bb30327432e9fae34e08121518e)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:25.501103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:25.503539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 534/1056] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:25 2022] GET /identity/v3/users/c5ea6bb30327432e9fae34e08121518e => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:25.508995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:25.607725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ca4f2-3388-454c-90c9-dc03c406ef86 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:25.639522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:25.640171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:25.640455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:25.640731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:25.704916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:25.706365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:25.798522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 523/1057] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:25.804704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:25.899255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3929d-1d54-4a71-abc1-4ad2962b4e7d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:25.931761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da70014-da34-4110-a531-302525098d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:25.932621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da70014-da34-4110-a531-302525098d4d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:25.932909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da70014-da34-4110-a531-302525098d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:25.933191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da70014-da34-4110-a531-302525098d4d None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:25.934416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da70014-da34-4110-a531-302525098d4d None admin] RBAC: Authorizing `identity:get_project(project_id=a275d31422e4445f90dcdfcb163f43df)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:25.935916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da70014-da34-4110-a531-302525098d4d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:25.937778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 535/1058] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:25 2022] GET /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:25.944680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:26.044318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bf226-3458-413f-bcce-bb70e2087476 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:26.075869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:26.076529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.076813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.077092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.077913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=a275d31422e4445f90dcdfcb163f43df, user.id=c5ea6bb30327432e9fae34e08121518e) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:26.078268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:26.079710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f6f9a-d430-4b77-9db7-d895b67a5775 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:26.094245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 524/1059] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:25 2022] GET /identity/v3/role_assignments?user.id=c5ea6bb30327432e9fae34e08121518e&scope.project.id=a275d31422e4445f90dcdfcb163f43df&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:26.705468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457418-9be6-46ca-bfcc-8c9b0f812e29 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.705468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457418-9be6-46ca-bfcc-8c9b0f812e29 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.705468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c457418-9be6-46ca-bfcc-8c9b0f812e29 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.706110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed556b0-3977-441f-8b4e-c89d6da9bfbc None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.706110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed556b0-3977-441f-8b4e-c89d6da9bfbc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.706110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed556b0-3977-441f-8b4e-c89d6da9bfbc None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.706899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 536/1060] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:26.707473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 525/1061] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:26.711589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.711952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.712275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.712373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.712561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.712837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.728863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:26.729699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:26.730108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:26.730885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:26.796804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 537/1062] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:26.801999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 526/1063] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:26.820286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:26.821447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:26.916671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457beb6-9589-4af4-a0f4-634b46b39510 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:26.919079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fec517-34f0-4259-94f6-ce53ce539a50 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:26.951370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:26.952015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.952302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.952578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.953467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:26.954263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:26.954544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:26.954811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:26.967203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:26.975093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 26 13:52:26.976459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 538/1064] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 26 13:52:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:26.982242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.018221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.019696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.078205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f9a91-32be-40c1-ac84-66c20287207d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.111294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.112303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.112790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.113425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 527/1065] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:27.113563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.114857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:27.115175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.116546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.119334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.124539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 539/1066] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:52:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:27.130709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.225584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca67e69-8e31-415a-8e67-227c1a8f8210 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.231524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895e411-6e2c-4bec-a1d4-d861d77a7d56 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.260034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.261089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.261472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.261741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.264368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.265147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.265430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.265705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.271962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.273414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.275985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.277390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.290525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:27.291897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 528/1067] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:27.293792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:27.299407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 540/1068] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:27.299535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.300336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.394028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea1ce6-7129-48b1-8d8f-2f3f64cc94c3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.396923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b228e20-32c6-4491-9f56-3be02b7e2653 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.427237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.427890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.428172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.428446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.429157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:27.429478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.430857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.431410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.432244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.432701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.433152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.434065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:27.434559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.436062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.445299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 529/1069] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:27.452815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 541/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:27.459371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.562368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf56d51-2624-4634-9021-b231ff1075b9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.596668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.597469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.597750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.598052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.606279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.607768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.621732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:52:27.622960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 530/1071] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:27.628749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.734336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9eb12-d777-4262-b1ad-cc00d8b8127e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.770308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.771216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.771664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.771939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.772780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:27.773090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.774558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.791912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 542/1072] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:27.797401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:27.891820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda7176-1440-4d6d-90ef-4a81a383a28f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:27.923715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:27.924533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:27.924816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:27.925092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:27.935112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:27.936551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:27.953022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:27.954415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 531/1073] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:27.960416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.057754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551959f0-5a36-4d08-9a31-9c99562457e2 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.091036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.091689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.091972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.092249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.092968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:28.093275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:28.094656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:28.105368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 543/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:28.110929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.206669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00046100-26c0-4424-993e-ef723c62e560 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.238492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.239293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.239582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.239856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.246441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:28.247886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:28.261978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-b7e95693-50ff-49d1-8325-b4b39d3f7dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:28.263159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 532/1075] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:28.268872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.364762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fa3c9-9834-4677-a71a-6c7feeb8d4b9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.389602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ebfb1-ff0e-4e63-888c-b2a9f189ab0a None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.389888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ebfb1-ff0e-4e63-888c-b2a9f189ab0a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.390194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ebfb1-ff0e-4e63-888c-b2a9f189ab0a None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.392098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 533/1076] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:28.396880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.397054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.397176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.397427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.397689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.397993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.398309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.399140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:28.399456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:28.400872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:28.413122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 544/1077] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:28.414939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:28.416187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:28.418678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.481817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 534/1078] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:28.504817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.513869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c228b-718e-4f47-bf5c-8ccb1b120acd None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.546248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.547210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.547497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.547775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/8b647906359a4d8bb2e0cf3098d62967/roles/28ce3c4c070c42dcb0cdcf2d8768acee` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.550623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=8b647906359a4d8bb2e0cf3098d62967, role_id=28ce3c4c070c42dcb0cdcf2d8768acee)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:28.552049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:28.597613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f998a-6f28-4a2c-abc9-39c671b102aa None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.618751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 545/1079] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:52:28 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/8b647906359a4d8bb2e0cf3098d62967/roles/28ce3c4c070c42dcb0cdcf2d8768acee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 13:52:28.630611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.631435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.631718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.631991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.643903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:28.651300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:52:28.652767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 535/1080] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:28.660742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.763240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c09af-c237-4b4b-8204-f5fada87bf7d None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.801241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.801917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.802289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.802569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.803327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:28.803636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:28.805001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:28.813828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 546/1081] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:28.819847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:28.913392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab431f3-e56a-4ae5-8140-0fdae0931af6 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:28.949071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:28.949948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:28.950253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:28.950525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] PATH_INFO: `/v3/users/c5ea6bb30327432e9fae34e08121518e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:28.951704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] RBAC: Authorizing `identity:get_user(user_id=c5ea6bb30327432e9fae34e08121518e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:28.953137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:28.954800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 536/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:28 2022] GET /identity/v3/users/c5ea6bb30327432e9fae34e08121518e => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:28.960974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:29.056006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44de03-a8be-4981-b942-7ab06dd919fb None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:29.087814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e89856-3101-4e04-b5f6-669b2d5bc4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:29.088650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89856-3101-4e04-b5f6-669b2d5bc4fa None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:29.088937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89856-3101-4e04-b5f6-669b2d5bc4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:29.089210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e89856-3101-4e04-b5f6-669b2d5bc4fa None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:29.090419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e89856-3101-4e04-b5f6-669b2d5bc4fa None admin] RBAC: Authorizing `identity:get_project(project_id=a275d31422e4445f90dcdfcb163f43df)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:29.091841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e89856-3101-4e04-b5f6-669b2d5bc4fa None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:29.093507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 547/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:28 2022] GET /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:29.099935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:29.192269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0c56a-6062-4c3b-9d7a-a34cc39653b9 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:29.225265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312fad2-93bb-4e56-8e23-2eb3fb0aea44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:29.226211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312fad2-93bb-4e56-8e23-2eb3fb0aea44 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:29.226488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312fad2-93bb-4e56-8e23-2eb3fb0aea44 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:29.226756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312fad2-93bb-4e56-8e23-2eb3fb0aea44 None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df/users/c5ea6bb30327432e9fae34e08121518e/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:29.228681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312fad2-93bb-4e56-8e23-2eb3fb0aea44 None admin] RBAC: Authorizing `identity:create_grant(project_id=a275d31422e4445f90dcdfcb163f43df, user_id=c5ea6bb30327432e9fae34e08121518e, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:29.230234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312fad2-93bb-4e56-8e23-2eb3fb0aea44 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:29.508205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 537/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:52:29 2022] PUT /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df/users/c5ea6bb30327432e9fae34e08121518e/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:52:30.880361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c49eb-286f-4231-9907-439c5cba0381 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:30.880908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c49eb-286f-4231-9907-439c5cba0381 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:30.880908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c49eb-286f-4231-9907-439c5cba0381 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:30.882729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 548/1085] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:30.887965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:30.888379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:30.888521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:30.905395 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:30.906601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:30.968660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 538/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:30.991869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c49eb-286f-4231-9907-439c5cba0381 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.087211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c49eb-286f-4231-9907-439c5cba0381 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:31.118905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:31.119699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.119980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.120253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.130452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:31.137650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 26 13:52:31.138849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 549/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Tue Apr 26 13:52:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:31.144846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.236268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f79eff-209f-48e6-9538-83cfab51cf95 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:31.268455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:31.269115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.269397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.269669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.270444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:31.270748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:31.272105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:31.279708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 539/1088] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:31.285480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.380338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fafd30-28e6-40a9-bbf0-d73a488ea34a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:31.411911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:31.412905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.413188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.413462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.425818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:31.427328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:31.448049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:31.449293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 550/1089] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:31.455078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.548774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be342c1-3500-4994-9657-98eda118ec30 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:31.580164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:31.580864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.581149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.581423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.582184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:31.582489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:31.583849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:31.595094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 540/1090] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:31.601129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.695946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d88fed-306e-4b14-9d18-cc50b81d5fa6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:31.727310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:31.729929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.729929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.729929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.735836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:31.737326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:31.750557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6090404d-2fe3-4b71-b9f1-7e4c5924aec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 26 13:52:31.751705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 551/1091] 10.222.0.23 () {56 vars in 1093 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:31.758111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.773572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd594c-bc90-4663-bdc5-e56bf50f3199 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.773863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd594c-bc90-4663-bdc5-e56bf50f3199 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.774276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd594c-bc90-4663-bdc5-e56bf50f3199 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.776100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 552/1092] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 13:52:31.781168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35708fe-7945-4679-b43a-62136deca95c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.781449 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35708fe-7945-4679-b43a-62136deca95c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.781724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35708fe-7945-4679-b43a-62136deca95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.879250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-f35708fe-7945-4679-b43a-62136deca95c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:31.880488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f35708fe-7945-4679-b43a-62136deca95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:31.930250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad613e24-ab6a-4b5d-81bf-53353c04267f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:31.943097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 553/1093] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:31.963312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:31.963911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:31.964187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:31.964457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:31.965325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:31.965715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:31.966273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35708fe-7945-4679-b43a-62136deca95c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:31.967183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:31.984432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 541/1094] 10.222.0.23 () {56 vars in 1133 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:31.990698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.066658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35708fe-7945-4679-b43a-62136deca95c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.083028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b85c68-a6f4-4fa2-8290-702d99f1ff52 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.097937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.098744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.099026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.099296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.108883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:32.114924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.115560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.115840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.116113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.116206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:52:32.117340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 554/1095] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:32.123177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.179925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.181373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.215522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010aa594-d80f-400a-af47-a417b4baedd9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.246543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104928-4100-4871-877f-32917a69da29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.247183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104928-4100-4871-877f-32917a69da29 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.247467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104928-4100-4871-877f-32917a69da29 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.247741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104928-4100-4871-877f-32917a69da29 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.248477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104928-4100-4871-877f-32917a69da29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:32.248778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104928-4100-4871-877f-32917a69da29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.250222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104928-4100-4871-877f-32917a69da29 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.258379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 555/1096] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:32.263975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104928-4100-4871-877f-32917a69da29 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.278394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 542/1097] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 26 13:52:32.279389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.355500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104928-4100-4871-877f-32917a69da29 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.369932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4254b7-39ce-4dde-9de7-401260f7eb57 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.386742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.387582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.387862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.388134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] PATH_INFO: `/v3/users/c5ea6bb30327432e9fae34e08121518e` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.389313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] RBAC: Authorizing `identity:get_user(user_id=c5ea6bb30327432e9fae34e08121518e)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.390773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.392359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 556/1098] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/users/c5ea6bb30327432e9fae34e08121518e => generated 285 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:32.397834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.401542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.402358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.402639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.402911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.413238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.414717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.431314 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:52:32.432466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 543/1099] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:32.438142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.494540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109587b6-b74e-4ee2-8678-04c2a975ac1e None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.525768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.526436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.526725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.527005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.530327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706b55c-acda-4bd8-8352-411dd37c70b8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.567733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.568389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.568671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.568945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.569654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:32.569957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.571342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.582619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 544/1100] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:32.587834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.592835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.593548 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.681906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fe9b8-4f97-4a15-a788-6aa533362e15 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.687711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 557/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 26 13:52:32.693463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.713487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.714301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.714584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.714856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.721712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.723191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.736115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:52:32.737294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 545/1102] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:52:32.742894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.785592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccca0ae-5340-4074-a5ff-2892601d8993 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.817471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.818329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.818612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.818886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.820050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] RBAC: Authorizing `identity:get_project(project_id=a275d31422e4445f90dcdfcb163f43df)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.821467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.823191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 558/1103] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:32.828932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.835068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e5ea5-94fe-4699-b72b-01e6113af68e None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.867021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.867667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.867945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.868216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.868982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:32.869281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.870716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.881543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 546/1104] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:32.887358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:32.921370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6a09d-834a-430c-bc0a-741eeb847533 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:32.952558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:32.953191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:32.953477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:32.953755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:32.954609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=a275d31422e4445f90dcdfcb163f43df, user.id=c5ea6bb30327432e9fae34e08121518e) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:32.954918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:32.956877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a933ad-f6cc-460f-b9ec-e066eb207353 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:32.962430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 559/1105] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/role_assignments?user.id=c5ea6bb30327432e9fae34e08121518e&scope.project.id=a275d31422e4445f90dcdfcb163f43df&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:32.980686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b00c0-5c33-4dc2-8664-dc67192ab021 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:33.015615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:33.016272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:33.016553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:33.016827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:33.017709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] RBAC: Adding query filter params (role.id=28ce3c4c070c42dcb0cdcf2d8768acee, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=8b647906359a4d8bb2e0cf3098d62967) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:33.018552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:33.019995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf3c0d-5918-4acd-a4ba-c5b4908f620e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:33.026283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 547/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:32 2022] GET /identity/v3/role_assignments?user.id=8b647906359a4d8bb2e0cf3098d62967&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=28ce3c4c070c42dcb0cdcf2d8768acee => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:52:35.287307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fec4e-6ee7-4dee-b54f-84640ca18744 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:35.288123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fec4e-6ee7-4dee-b54f-84640ca18744 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:35.288123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fec4e-6ee7-4dee-b54f-84640ca18744 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:35.289884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 560/1107] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:35.295024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:35.295398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:35.295583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:35.311752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:35.312937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:35.374211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 548/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:35.399090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fec4e-6ee7-4dee-b54f-84640ca18744 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:35.496033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fec4e-6ee7-4dee-b54f-84640ca18744 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:35.528183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ab577-0f45-4c22-aa9c-ba2f2f224ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:35.528960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab577-0f45-4c22-aa9c-ba2f2f224ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:35.529244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab577-0f45-4c22-aa9c-ba2f2f224ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:35.529523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ab577-0f45-4c22-aa9c-ba2f2f224ac3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:35.530705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab577-0f45-4c22-aa9c-ba2f2f224ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:35.532116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ab577-0f45-4c22-aa9c-ba2f2f224ac3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:35.533731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 561/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:35.539679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:35.638892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad8c8-0e50-47ca-a097-9ba60218ef28 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:35.672429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52482bda-84c9-4355-8c2a-c5e8d5c2dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:35.673087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52482bda-84c9-4355-8c2a-c5e8d5c2dd1d None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:35.673365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52482bda-84c9-4355-8c2a-c5e8d5c2dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:35.673636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52482bda-84c9-4355-8c2a-c5e8d5c2dd1d None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:35.674389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52482bda-84c9-4355-8c2a-c5e8d5c2dd1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:35.675808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52482bda-84c9-4355-8c2a-c5e8d5c2dd1d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:35.755263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 549/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:52:35 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:38.084996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477310fa-a882-414d-9a97-eae8e219f5e2 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:38.085533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477310fa-a882-414d-9a97-eae8e219f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:38.085533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477310fa-a882-414d-9a97-eae8e219f5e2 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:38.087376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 562/1111] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:38.092472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:38.092906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:38.093030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:38.109353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:38.110574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:38.172908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 550/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:38.196766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477310fa-a882-414d-9a97-eae8e219f5e2 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:38.292021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477310fa-a882-414d-9a97-eae8e219f5e2 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:38.323402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:38.324244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:38.324524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:38.324797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] PATH_INFO: `/v3/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:38.326288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] RBAC: Authorizing `identity:get_role(role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:38.327641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:38.328966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 563/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:38 2022] GET /identity/v3/roles/2481fa0f9e714a879311d70b522a9956 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:38.334517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:38.426090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6907e09-934e-412e-8a0c-33ac0dd24337 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:38.457169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:38.458065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:38.458345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:38.458622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] PATH_INFO: `/v3/users/d9d75d99d3c9401bb7232b09fb09ba58` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:38.471333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d75d99d3c9401bb7232b09fb09ba58)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:38.472772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:38.474462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 551/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:38 2022] GET /identity/v3/users/d9d75d99d3c9401bb7232b09fb09ba58 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:38.480094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:38.573840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feee7f-d2a1-4234-9366-a72e94c1ac16 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:38.605299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:38.605924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:38.606238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:38.606515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:38.669145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:38.670585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:38.761476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 564/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:38.767147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:38.860431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f16bbe-14c5-454d-860a-e695b2f05432 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:38.892604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fda33-0469-4c40-8872-e2613aa8ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:38.893454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fda33-0469-4c40-8872-e2613aa8ee56 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:38.893736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fda33-0469-4c40-8872-e2613aa8ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:38.894034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fda33-0469-4c40-8872-e2613aa8ee56 None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:38.895207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fda33-0469-4c40-8872-e2613aa8ee56 None admin] RBAC: Authorizing `identity:get_project(project_id=a275d31422e4445f90dcdfcb163f43df)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:38.896631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fda33-0469-4c40-8872-e2613aa8ee56 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:38.898320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 552/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:38 2022] GET /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:38.904247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:38.997777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80913db9-13b1-4078-b76b-50de9239bb3b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:39.028844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:39.029427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:39.029708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:39.030000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:39.030824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] RBAC: Adding query filter params (role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=a275d31422e4445f90dcdfcb163f43df, user.id=d9d75d99d3c9401bb7232b09fb09ba58) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:39.031133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:39.032540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02825d-c793-4bf9-b69c-526bd90a0a68 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:39.038463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 565/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:38 2022] GET /identity/v3/role_assignments?user.id=d9d75d99d3c9401bb7232b09fb09ba58&scope.project.id=a275d31422e4445f90dcdfcb163f43df&role.id=2481fa0f9e714a879311d70b522a9956 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:41.264690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76beaf6-d84d-4d76-9b7d-093bb56fb0f7 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:41.265239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76beaf6-d84d-4d76-9b7d-093bb56fb0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:41.265239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76beaf6-d84d-4d76-9b7d-093bb56fb0f7 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:41.267057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 553/1118] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:41.272232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:41.272615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:41.272780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:41.289707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:41.290920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:41.352657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 566/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:41.375164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76beaf6-d84d-4d76-9b7d-093bb56fb0f7 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:41.469901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76beaf6-d84d-4d76-9b7d-093bb56fb0f7 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:41.501921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:41.502789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:41.503067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:41.503335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] PATH_INFO: `/v3/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:41.504795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] RBAC: Authorizing `identity:get_role(role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:41.506183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:41.507530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 554/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:41 2022] GET /identity/v3/roles/2481fa0f9e714a879311d70b522a9956 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:41.513229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:41.605450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383363c-72f1-458c-b6d3-11325b94694e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:41.636966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:41.637816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:41.638140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:41.638418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] PATH_INFO: `/v3/users/d9d75d99d3c9401bb7232b09fb09ba58` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:41.639582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d75d99d3c9401bb7232b09fb09ba58)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:41.640988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:41.643180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 567/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:41 2022] GET /identity/v3/users/d9d75d99d3c9401bb7232b09fb09ba58 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:41.648619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:41.741235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b13b2-fff1-4ff8-9d94-a606aee396a7 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:41.773744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9d9a6-fc0e-4fd3-99f4-f2b98d69637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:41.774620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9d9a6-fc0e-4fd3-99f4-f2b98d69637b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:41.774902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9d9a6-fc0e-4fd3-99f4-f2b98d69637b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:41.775178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9d9a6-fc0e-4fd3-99f4-f2b98d69637b None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:41.776338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9d9a6-fc0e-4fd3-99f4-f2b98d69637b None admin] RBAC: Authorizing `identity:get_project(project_id=a275d31422e4445f90dcdfcb163f43df)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:41.777769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9d9a6-fc0e-4fd3-99f4-f2b98d69637b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:41.779468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 555/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:41 2022] GET /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:41.786231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:41.884222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d78f3-e917-479f-8f2f-bbe727473b81 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:41.916234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f39ae-1b83-4e99-9bff-2ca77a3e2603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:41.917090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f39ae-1b83-4e99-9bff-2ca77a3e2603 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:41.917372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f39ae-1b83-4e99-9bff-2ca77a3e2603 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:41.917646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f39ae-1b83-4e99-9bff-2ca77a3e2603 None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df/users/d9d75d99d3c9401bb7232b09fb09ba58/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:41.919823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f39ae-1b83-4e99-9bff-2ca77a3e2603 None admin] RBAC: Authorizing `identity:create_grant(project_id=a275d31422e4445f90dcdfcb163f43df, user_id=d9d75d99d3c9401bb7232b09fb09ba58, role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:41.921228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f39ae-1b83-4e99-9bff-2ca77a3e2603 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:42.006282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 568/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:52:41 2022] PUT /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df/users/d9d75d99d3c9401bb7232b09fb09ba58/roles/2481fa0f9e714a879311d70b522a9956 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:52:44.247981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4e31-f4e7-48e6-b57b-2f4d15f2884d None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:44.248511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4e31-f4e7-48e6-b57b-2f4d15f2884d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:44.248511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4e31-f4e7-48e6-b57b-2f4d15f2884d None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:44.250379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 556/1124] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:44.255940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:44.256380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:44.256494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:44.273499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:44.274713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:44.337386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 569/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:44.360545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4e31-f4e7-48e6-b57b-2f4d15f2884d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:44.466471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4e31-f4e7-48e6-b57b-2f4d15f2884d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:44.497087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:44.497928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:44.498280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:44.498501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] PATH_INFO: `/v3/roles/2481fa0f9e714a879311d70b522a9956` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:44.500056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] RBAC: Authorizing `identity:get_role(role_id=2481fa0f9e714a879311d70b522a9956)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:44.501414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:44.503341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 557/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:44 2022] GET /identity/v3/roles/2481fa0f9e714a879311d70b522a9956 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:44.509164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:44.603455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2bf15-047e-4836-b68f-1df4987cbbaf None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:44.635945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:44.636796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:44.637084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:44.637366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] PATH_INFO: `/v3/users/d9d75d99d3c9401bb7232b09fb09ba58` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:44.638570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d75d99d3c9401bb7232b09fb09ba58)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:44.640002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:44.641611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 570/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:44 2022] GET /identity/v3/users/d9d75d99d3c9401bb7232b09fb09ba58 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:44.647315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:44.748414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e80c6-a0d1-4508-93e9-3d40c3d629d5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:44.789357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:44.790018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:44.790301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:44.790571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:44.853121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:44.854630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:44.945660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 558/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:44.951470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:45.046679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726f63-2c09-48ca-8e03-50afba9fca97 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:45.079218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc99780-54e4-45b0-a16a-dee03efc1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:45.080063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc99780-54e4-45b0-a16a-dee03efc1015 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:45.080345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc99780-54e4-45b0-a16a-dee03efc1015 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:45.080619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc99780-54e4-45b0-a16a-dee03efc1015 None admin] PATH_INFO: `/v3/projects/a275d31422e4445f90dcdfcb163f43df` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:45.081785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc99780-54e4-45b0-a16a-dee03efc1015 None admin] RBAC: Authorizing `identity:get_project(project_id=a275d31422e4445f90dcdfcb163f43df)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:45.083238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc99780-54e4-45b0-a16a-dee03efc1015 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:45.084922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 571/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:44 2022] GET /identity/v3/projects/a275d31422e4445f90dcdfcb163f43df => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:45.091128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:45.184076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550280c4-55f6-4359-a9a4-dc12560e9692 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:45.215012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:45.215649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:45.215933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:45.216207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:45.217021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] RBAC: Adding query filter params (role.id=2481fa0f9e714a879311d70b522a9956, scope.project.id=a275d31422e4445f90dcdfcb163f43df, user.id=d9d75d99d3c9401bb7232b09fb09ba58) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:45.217331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:45.218778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d31ab-b1bc-41d8-87f5-9f2fe04b3b2e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:45.224788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 559/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:45 2022] GET /identity/v3/role_assignments?user.id=d9d75d99d3c9401bb7232b09fb09ba58&scope.project.id=a275d31422e4445f90dcdfcb163f43df&role.id=2481fa0f9e714a879311d70b522a9956 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:47.480873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddecc5-7631-4940-8a4e-215ffc59c416 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:47.481365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddecc5-7631-4940-8a4e-215ffc59c416 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:47.481460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddecc5-7631-4940-8a4e-215ffc59c416 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:47.483250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 572/1131] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:47.488460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:47.488903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:47.489004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:47.505764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:47.506995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:47.570040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 560/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:47.592867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddecc5-7631-4940-8a4e-215ffc59c416 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:47.688175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddecc5-7631-4940-8a4e-215ffc59c416 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:47.719788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94171c4e-37bb-4533-b01f-50fc37433c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:47.721081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171c4e-37bb-4533-b01f-50fc37433c6d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:47.721365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171c4e-37bb-4533-b01f-50fc37433c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:47.721643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94171c4e-37bb-4533-b01f-50fc37433c6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:47.722843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171c4e-37bb-4533-b01f-50fc37433c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:47.724261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94171c4e-37bb-4533-b01f-50fc37433c6d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:47.725846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 573/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:47.731230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:47.821763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc845c-fc3b-4dc2-b22f-49e0d8d79ab5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:47.853817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af01864-d14b-46fd-9450-ab6c958a4d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:47.854497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01864-d14b-46fd-9450-ab6c958a4d4b None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:47.854781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01864-d14b-46fd-9450-ab6c958a4d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:47.855055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af01864-d14b-46fd-9450-ab6c958a4d4b None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:47.855756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01864-d14b-46fd-9450-ab6c958a4d4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:47.857170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af01864-d14b-46fd-9450-ab6c958a4d4b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:47.944360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 561/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:52:47 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:52:50.255197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68de41-d337-418b-a9f2-91bdb325bcc2 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:50.255718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68de41-d337-418b-a9f2-91bdb325bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:50.255811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68de41-d337-418b-a9f2-91bdb325bcc2 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:50.257634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 574/1135] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:50.262916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:50.263345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:50.263466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:50.279707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:50.280868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:50.342790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 562/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 26 13:52:50.368060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68de41-d337-418b-a9f2-91bdb325bcc2 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:50.461884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68de41-d337-418b-a9f2-91bdb325bcc2 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:50.493816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ade6a6-e19a-4775-bef5-4bd69d83eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:50.494608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ade6a6-e19a-4775-bef5-4bd69d83eb9c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:50.494890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ade6a6-e19a-4775-bef5-4bd69d83eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:50.495163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ade6a6-e19a-4775-bef5-4bd69d83eb9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:50.496317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ade6a6-e19a-4775-bef5-4bd69d83eb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:50.497728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ade6a6-e19a-4775-bef5-4bd69d83eb9c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:50.499333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 575/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:50.504940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:50.595781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c966103-81e7-452c-a0bf-2b53d241389c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:50.626837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ce881-f344-4db8-a3f8-051e4002d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:50.627476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ce881-f344-4db8-a3f8-051e4002d501 None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:50.627752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ce881-f344-4db8-a3f8-051e4002d501 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:50.628017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ce881-f344-4db8-a3f8-051e4002d501 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:50.628706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ce881-f344-4db8-a3f8-051e4002d501 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:50.630155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ce881-f344-4db8-a3f8-051e4002d501 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:50.729877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 563/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:52:50 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 13:52:53.021906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bb74a-ad85-45d9-888c-f70b326c37b4 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.022477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bb74a-ad85-45d9-888c-f70b326c37b4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.022477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bb74a-ad85-45d9-888c-f70b326c37b4 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.024261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 576/1139] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:53.029397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.029795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.029950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.046595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:53.047779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:53.110319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 564/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:53.134069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bb74a-ad85-45d9-888c-f70b326c37b4 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:53.228480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bb74a-ad85-45d9-888c-f70b326c37b4 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:53.259896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:53.260654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.260934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.261207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.270657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:53.277415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:52:53.278503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 577/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:53.284868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:53.376647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082e2f6-1e87-4bac-9713-57853c1e47b5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:53.408169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:53.408815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.409092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.409361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.410118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:53.410418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:53.411769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:53.419519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 565/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:53.425638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:53.519361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2a45-0a60-4404-a299-e3d743b57f60 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:53.551837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:53.552637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.552924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.553201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] PATH_INFO: `/v3/users/65784e4898cd4eb986855f940c28ec73` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.565588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=65784e4898cd4eb986855f940c28ec73)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:53.567060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:53.568694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 578/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:53 2022] GET /identity/v3/users/65784e4898cd4eb986855f940c28ec73 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:53.574310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:53.667246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d3e31-01f7-4942-b19d-e08132fe5de3 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:53.697726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:53.698381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.698665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.698947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.761255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:53.762714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:53.854036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 566/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:52:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:52:53.859812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:53.951615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025191c3-c56d-4a53-a67c-47f194c98cd6 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:53.984261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d55d70-7430-43b7-b5aa-0e80074191e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:53.985096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d55d70-7430-43b7-b5aa-0e80074191e3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:53.985378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d55d70-7430-43b7-b5aa-0e80074191e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:53.985680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d55d70-7430-43b7-b5aa-0e80074191e3 None admin] PATH_INFO: `/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:53.986880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d55d70-7430-43b7-b5aa-0e80074191e3 None admin] RBAC: Authorizing `identity:get_project(project_id=dc7d9636f62a4ac7bbc5506f5e77704d)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:53.988283 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d55d70-7430-43b7-b5aa-0e80074191e3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:53.989914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 579/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:53 2022] GET /identity/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:53.995663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:54.088565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369c282-bacc-403d-8382-18b7170fe6cc None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:54.119900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:54.120488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:54.120770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:54.121160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:54.122184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=dc7d9636f62a4ac7bbc5506f5e77704d, user.id=65784e4898cd4eb986855f940c28ec73) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:54.122498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:54.123934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742795e-2b17-4993-9c11-b67f4a72ef0d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:54.129567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 567/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:52:53 2022] GET /identity/v3/role_assignments?user.id=65784e4898cd4eb986855f940c28ec73&scope.project.id=dc7d9636f62a4ac7bbc5506f5e77704d&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:56.350531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e19f1-a11e-40f9-b078-70698fbbc952 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:56.351163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e19f1-a11e-40f9-b078-70698fbbc952 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:56.351163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e19f1-a11e-40f9-b078-70698fbbc952 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:56.352879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 580/1147] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:56.358106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:56.358544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:56.358649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:56.374789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:56.375962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:56.439889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 568/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:56.462850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e19f1-a11e-40f9-b078-70698fbbc952 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:56.557652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e19f1-a11e-40f9-b078-70698fbbc952 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:56.590038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:56.590804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:56.591088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:56.591362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:56.601060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:56.607790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:52:56.608931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 581/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:52:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:56.615229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:56.706476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1608a-0188-48cc-96d1-6f4a623b7303 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:56.738261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:56.738909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:56.739192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:56.739467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:56.740206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:56.740511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:56.741912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:56.749504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 569/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:56.755794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:56.847929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cf658-aea7-40fe-9eed-1cda97e24718 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:56.880484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:56.881282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:56.881567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:56.881847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] PATH_INFO: `/v3/users/65784e4898cd4eb986855f940c28ec73` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:56.883074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] RBAC: Authorizing `identity:get_user(user_id=65784e4898cd4eb986855f940c28ec73)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:56.884488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:56.886111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 582/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:56 2022] GET /identity/v3/users/65784e4898cd4eb986855f940c28ec73 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:56.891548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:56.984906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb6be9-0393-467f-8106-55da7d95efd2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:57.016085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f8ee2-d4b9-4f80-ad48-8a572d4ebf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:57.016962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f8ee2-d4b9-4f80-ad48-8a572d4ebf25 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:57.017244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f8ee2-d4b9-4f80-ad48-8a572d4ebf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:57.017518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f8ee2-d4b9-4f80-ad48-8a572d4ebf25 None admin] PATH_INFO: `/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:57.018701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f8ee2-d4b9-4f80-ad48-8a572d4ebf25 None admin] RBAC: Authorizing `identity:get_project(project_id=dc7d9636f62a4ac7bbc5506f5e77704d)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:57.020124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f8ee2-d4b9-4f80-ad48-8a572d4ebf25 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:57.021771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 570/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:52:56 2022] GET /identity/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:57.027572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:57.121191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b3247-2349-4b91-b60b-0912ee996c02 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:57.151790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cef7ea-811f-4c0e-bf91-a60466dd4100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:57.152595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef7ea-811f-4c0e-bf91-a60466dd4100 None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:57.152879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef7ea-811f-4c0e-bf91-a60466dd4100 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:57.153160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cef7ea-811f-4c0e-bf91-a60466dd4100 None admin] PATH_INFO: `/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d/users/65784e4898cd4eb986855f940c28ec73/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:57.155115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef7ea-811f-4c0e-bf91-a60466dd4100 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc7d9636f62a4ac7bbc5506f5e77704d, user_id=65784e4898cd4eb986855f940c28ec73, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:57.156519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cef7ea-811f-4c0e-bf91-a60466dd4100 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:57.268895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 583/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:52:57 2022] PUT /identity/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d/users/65784e4898cd4eb986855f940c28ec73/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:52:59.501805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4655-7615-40b3-ad78-2d1a9611993d None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:59.502383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4655-7615-40b3-ad78-2d1a9611993d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:59.502681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4655-7615-40b3-ad78-2d1a9611993d None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:59.505435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 571/1154] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:52:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:52:59.512186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:59.512602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:59.512744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:59.531154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:52:59.532365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:52:59.594421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 584/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:52:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:52:59.617521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4655-7615-40b3-ad78-2d1a9611993d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:59.712236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4655-7615-40b3-ad78-2d1a9611993d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:59.744024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:59.744799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:59.745079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:59.745349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:59.755955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:52:59.762757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:52:59.763913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 572/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:52:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:52:59.769773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:52:59.867940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098a0d3-61ba-435a-a296-6b1673525414 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:52:59.899830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:52:59.900493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:52:59.900780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:52:59.901057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:52:59.901803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:52:59.902142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:52:59.903501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:52:59.911160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 585/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:52:59.917179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:00.011698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa4bdc-4b71-443a-99b5-9ecc7b5d2d90 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:00.044061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:00.044915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:00.045195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:00.045465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] PATH_INFO: `/v3/users/65784e4898cd4eb986855f940c28ec73` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:00.046740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] RBAC: Authorizing `identity:get_user(user_id=65784e4898cd4eb986855f940c28ec73)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:00.048783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:00.050449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 573/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:52:59 2022] GET /identity/v3/users/65784e4898cd4eb986855f940c28ec73 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:00.056103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:00.151039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8fce2-12c0-40f4-aef4-6cf338a399b1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:00.183455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:00.184097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:00.184384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:00.184665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:00.247161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:00.248590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:00.339497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 586/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:53:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:53:00.345888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:00.440205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dc5b8-0a0a-401a-ae9f-6b4493132d06 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:00.473021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf32a4-4981-4e9f-8b4a-d80f8e3e478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:00.473880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf32a4-4981-4e9f-8b4a-d80f8e3e478d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:00.474189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf32a4-4981-4e9f-8b4a-d80f8e3e478d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:00.474461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf32a4-4981-4e9f-8b4a-d80f8e3e478d None admin] PATH_INFO: `/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:00.475620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf32a4-4981-4e9f-8b4a-d80f8e3e478d None admin] RBAC: Authorizing `identity:get_project(project_id=dc7d9636f62a4ac7bbc5506f5e77704d)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:00.477041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf32a4-4981-4e9f-8b4a-d80f8e3e478d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:00.478746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 574/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:53:00 2022] GET /identity/v3/projects/dc7d9636f62a4ac7bbc5506f5e77704d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:00.484782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:00.576580 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707b7-b079-4b17-8b57-b485e3ffd0ae None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:00.608945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:00.609531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:00.609817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:00.610126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:00.610990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=dc7d9636f62a4ac7bbc5506f5e77704d, user.id=65784e4898cd4eb986855f940c28ec73) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:00.611305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:00.612717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c19c4b-fe69-41bf-a755-6ecbc09650f0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:00.618259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 587/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:53:00 2022] GET /identity/v3/role_assignments?user.id=65784e4898cd4eb986855f940c28ec73&scope.project.id=dc7d9636f62a4ac7bbc5506f5e77704d&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:02.877519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba5b72-cfde-4724-acf0-8fcb30042c20 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:02.878085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba5b72-cfde-4724-acf0-8fcb30042c20 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:02.878085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba5b72-cfde-4724-acf0-8fcb30042c20 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:02.879868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 575/1162] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:02.885030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:02.885468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:02.885568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:02.902396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:02.903572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:02.966317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 588/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:02.988827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba5b72-cfde-4724-acf0-8fcb30042c20 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:03.086235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba5b72-cfde-4724-acf0-8fcb30042c20 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:03.118061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b033-9086-4306-b665-65317988a885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:03.118706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b033-9086-4306-b665-65317988a885 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:03.118988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b033-9086-4306-b665-65317988a885 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:03.119263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534b033-9086-4306-b665-65317988a885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:03.182139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b033-9086-4306-b665-65317988a885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:03.183527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534b033-9086-4306-b665-65317988a885 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:03.274819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 576/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:53:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:53:03.280858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:03.372463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b5bb7-0402-47b7-a933-32e82e8837b2 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:03.404117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:03.404898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:03.405182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:03.405458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:03.412065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:03.413741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:03.427126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6ec611a0-9ea7-453c-b4d4-f7842983b453 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 26 13:53:03.428261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 589/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:53:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:53:03.434182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b033-9086-4306-b665-65317988a885 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:03.525862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534b033-9086-4306-b665-65317988a885 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:03.557684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:03.558429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:03.558711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:03.558986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:03.559696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:03.560001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:03.561361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792606-3f1b-4a20-8fac-26d249d17d62 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:03.568700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 577/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Tue Apr 26 13:53:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:05.789707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5bbf7-0bce-4675-b814-595ce36ff9f2 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:05.790253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5bbf7-0bce-4675-b814-595ce36ff9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:05.790253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5bbf7-0bce-4675-b814-595ce36ff9f2 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:05.792008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 590/1167] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:05.797186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e11df-e140-4320-818f-ce1d421b6ce7 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:05.797632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e11df-e140-4320-818f-ce1d421b6ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:05.797739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e11df-e140-4320-818f-ce1d421b6ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:05.814155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-974e11df-e140-4320-818f-ce1d421b6ce7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:05.815344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-974e11df-e140-4320-818f-ce1d421b6ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:05.876747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 578/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:05.899131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5bbf7-0bce-4675-b814-595ce36ff9f2 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:05.993405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5bbf7-0bce-4675-b814-595ce36ff9f2 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:06.025790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e14261-3472-4cc7-a228-d16e224adb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:06.026445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14261-3472-4cc7-a228-d16e224adb49 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:06.026729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14261-3472-4cc7-a228-d16e224adb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:06.027003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e14261-3472-4cc7-a228-d16e224adb49 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:06.027732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14261-3472-4cc7-a228-d16e224adb49 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:06.029060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e14261-3472-4cc7-a228-d16e224adb49 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:06.095978 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 591/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Tue Apr 26 13:53:05 2022] POST /identity/v3/domains => generated 267 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:53:08.376491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8ea3-c48e-46a2-b89f-9a9bf9639f0e None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:08.377054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8ea3-c48e-46a2-b89f-9a9bf9639f0e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:08.377054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace8ea3-c48e-46a2-b89f-9a9bf9639f0e None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:08.378871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 579/1170] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:08.383994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:08.384356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:08.384543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:08.400960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:08.402162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:08.464299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 592/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:08.488076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace8ea3-c48e-46a2-b89f-9a9bf9639f0e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:08.582773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace8ea3-c48e-46a2-b89f-9a9bf9639f0e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:08.614829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff0ed5-a5cc-4337-a0e9-1d55c904f7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:08.615677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff0ed5-a5cc-4337-a0e9-1d55c904f7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:08.615953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff0ed5-a5cc-4337-a0e9-1d55c904f7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:08.616222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff0ed5-a5cc-4337-a0e9-1d55c904f7b0 None admin] PATH_INFO: `/v3/domains/1dc415942410468dab250a68d19267c2` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:08.626069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff0ed5-a5cc-4337-a0e9-1d55c904f7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1dc415942410468dab250a68d19267c2)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:08.627567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff0ed5-a5cc-4337-a0e9-1d55c904f7b0 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:08.629103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 580/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Apr 26 13:53:08 2022] GET /identity/v3/domains/1dc415942410468dab250a68d19267c2 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:08.634624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:08.725708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53bfec-60b1-4794-88c6-2ce266ac245c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:08.756418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd91a98-0223-4765-a937-7f9bac4d1687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:08.757051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd91a98-0223-4765-a937-7f9bac4d1687 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:08.757333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd91a98-0223-4765-a937-7f9bac4d1687 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:08.757610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd91a98-0223-4765-a937-7f9bac4d1687 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:08.758329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd91a98-0223-4765-a937-7f9bac4d1687 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:08.759735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd91a98-0223-4765-a937-7f9bac4d1687 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:08.844481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 593/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:53:08 2022] POST /identity/v3/projects => generated 361 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:53:11.123479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e4230-a425-4b07-b246-dd808413d975 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:11.124028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e4230-a425-4b07-b246-dd808413d975 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:11.124028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e4230-a425-4b07-b246-dd808413d975 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:11.125801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 581/1174] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:11.131006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:11.131432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:11.131564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:11.148274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:11.149435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:11.211372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 594/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:11.236253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e4230-a425-4b07-b246-dd808413d975 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:11.330217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e4230-a425-4b07-b246-dd808413d975 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:11.360415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54631-cf21-470d-8358-ab7d966e722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:11.361252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54631-cf21-470d-8358-ab7d966e722d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:11.361532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54631-cf21-470d-8358-ab7d966e722d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:11.361804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54631-cf21-470d-8358-ab7d966e722d None admin] PATH_INFO: `/v3/domains/1dc415942410468dab250a68d19267c2` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:11.362990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54631-cf21-470d-8358-ab7d966e722d None admin] RBAC: Authorizing `identity:get_domain(domain_id=1dc415942410468dab250a68d19267c2)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:11.364419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54631-cf21-470d-8358-ab7d966e722d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:11.365984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 582/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Tue Apr 26 13:53:11 2022] GET /identity/v3/domains/1dc415942410468dab250a68d19267c2 => generated 267 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:11.371421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:11.463602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d0d5-a79d-4239-8829-c514b79923f7 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:11.494702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d20ffd-351a-4286-ae4c-9c8d8c9cea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:11.495351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20ffd-351a-4286-ae4c-9c8d8c9cea61 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:11.495634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20ffd-351a-4286-ae4c-9c8d8c9cea61 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:11.495908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d20ffd-351a-4286-ae4c-9c8d8c9cea61 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:11.496612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20ffd-351a-4286-ae4c-9c8d8c9cea61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:11.498039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d20ffd-351a-4286-ae4c-9c8d8c9cea61 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:11.603248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 595/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:53:11 2022] POST /identity/v3/users => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:53:13.908331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea07489-c8ac-42b6-acec-68eee50c5717 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:13.908876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea07489-c8ac-42b6-acec-68eee50c5717 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:13.908876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea07489-c8ac-42b6-acec-68eee50c5717 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:13.910671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 583/1178] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:13.915969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:13.916353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:13.916536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:13.933323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:13.934544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:13.996452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 596/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:14.020236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea07489-c8ac-42b6-acec-68eee50c5717 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:14.114210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea07489-c8ac-42b6-acec-68eee50c5717 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:14.152556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:14.152556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:14.152556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:14.152556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:14.163743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:53:14.170463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:53:14.171625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 584/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:53:14.178119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:14.270386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477acd19-b675-41b8-b90a-e0e975e377a5 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:14.303374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:14.304019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:14.304306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:14.304585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:14.305326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:14.305633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:14.307022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:14.314578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 597/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:14.320196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:14.414727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3797eb-879a-4778-8e6d-9a774dc678b2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:14.452725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:14.453592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:14.453872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:14.454175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] PATH_INFO: `/v3/users/c4c146423ec3470aaf482f7786fd20d9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:14.466865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] RBAC: Authorizing `identity:get_user(user_id=c4c146423ec3470aaf482f7786fd20d9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:14.468319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:14.470516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 585/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:53:14 2022] GET /identity/v3/users/c4c146423ec3470aaf482f7786fd20d9 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:14.476198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:14.569946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee3c9a-ce6b-47a7-9b5b-2ede659eb22a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:14.600970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:14.601601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:14.601886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:14.602194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:14.665637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:14.667034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:14.757095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 598/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:53:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:53:14.763037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:14.856834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9b3a-6d62-4cfd-b29c-521d0d47d0df None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:14.888451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f999a5-bfe6-4de2-b6d7-6fbb8dfc0095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:14.889291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f999a5-bfe6-4de2-b6d7-6fbb8dfc0095 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:14.889566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f999a5-bfe6-4de2-b6d7-6fbb8dfc0095 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:14.889835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f999a5-bfe6-4de2-b6d7-6fbb8dfc0095 None admin] PATH_INFO: `/v3/projects/ef9308fffd2646039fcd61ae55830c82` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:14.891020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f999a5-bfe6-4de2-b6d7-6fbb8dfc0095 None admin] RBAC: Authorizing `identity:get_project(project_id=ef9308fffd2646039fcd61ae55830c82)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:14.892443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f999a5-bfe6-4de2-b6d7-6fbb8dfc0095 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:14.894110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 586/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:53:14 2022] GET /identity/v3/projects/ef9308fffd2646039fcd61ae55830c82 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:14.900196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:14.993379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2144f7-3af2-40a0-9694-33de1774ab4a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:15.024770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:15.025415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:15.025705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:15.026007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:15.026834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=ef9308fffd2646039fcd61ae55830c82, user.id=c4c146423ec3470aaf482f7786fd20d9) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:15.027149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:15.028563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339930f-2dc1-40db-a31d-26be61cdbba4 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:15.034197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 599/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:53:14 2022] GET /identity/v3/role_assignments?user.id=c4c146423ec3470aaf482f7786fd20d9&scope.project.id=ef9308fffd2646039fcd61ae55830c82&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:17.274760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7cbb-fda4-4160-a1c0-74a6db05c408 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:17.275397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7cbb-fda4-4160-a1c0-74a6db05c408 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:17.275397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c7cbb-fda4-4160-a1c0-74a6db05c408 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:17.277085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 587/1186] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:17.282765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:17.283167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:17.283325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:17.300479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:17.301664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:17.364153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 600/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:17.386533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c7cbb-fda4-4160-a1c0-74a6db05c408 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:17.482028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c7cbb-fda4-4160-a1c0-74a6db05c408 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:17.513308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:17.514108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:17.514391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:17.514661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:17.524128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:53:17.531051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:53:17.532687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 588/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:53:17.538897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:17.631953 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add01c7-f9d6-4a9e-84be-ab107a5a6bea None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:17.664448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:17.665098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:17.665385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:17.665664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:17.666441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:17.666750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:17.668102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:17.675846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 601/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:17.681475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:17.774610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60128428-ad68-4066-9adf-6e00f36a17b1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:17.806169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:17.806946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:17.807224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:17.807495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] PATH_INFO: `/v3/users/c4c146423ec3470aaf482f7786fd20d9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:17.808660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] RBAC: Authorizing `identity:get_user(user_id=c4c146423ec3470aaf482f7786fd20d9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:17.810123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:17.811692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 589/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:53:17 2022] GET /identity/v3/users/c4c146423ec3470aaf482f7786fd20d9 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:17.817137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:17.911799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27301e88-4f69-46f5-971b-03173f8d5c06 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:17.942720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57053a8-7003-4022-a683-3882fe97655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:17.943554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57053a8-7003-4022-a683-3882fe97655f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:17.943837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57053a8-7003-4022-a683-3882fe97655f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:17.944110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57053a8-7003-4022-a683-3882fe97655f None admin] PATH_INFO: `/v3/projects/ef9308fffd2646039fcd61ae55830c82` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:17.945286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57053a8-7003-4022-a683-3882fe97655f None admin] RBAC: Authorizing `identity:get_project(project_id=ef9308fffd2646039fcd61ae55830c82)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:17.946738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57053a8-7003-4022-a683-3882fe97655f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:17.948390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 602/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:53:17 2022] GET /identity/v3/projects/ef9308fffd2646039fcd61ae55830c82 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:17.954450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:18.045363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a3277-cb43-424a-bff0-fba630e76e1b None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:18.076088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039d7d7-9d14-4671-9c97-0b803180368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:18.076947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d7d7-9d14-4671-9c97-0b803180368f None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:18.077228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d7d7-9d14-4671-9c97-0b803180368f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:18.077503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d7d7-9d14-4671-9c97-0b803180368f None admin] PATH_INFO: `/v3/projects/ef9308fffd2646039fcd61ae55830c82/users/c4c146423ec3470aaf482f7786fd20d9/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:18.079992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039d7d7-9d14-4671-9c97-0b803180368f None admin] RBAC: Authorizing `identity:create_grant(project_id=ef9308fffd2646039fcd61ae55830c82, user_id=c4c146423ec3470aaf482f7786fd20d9, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:18.081406 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039d7d7-9d14-4671-9c97-0b803180368f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:18.200037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 590/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:53:17 2022] PUT /identity/v3/projects/ef9308fffd2646039fcd61ae55830c82/users/c4c146423ec3470aaf482f7786fd20d9/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:53:20.470821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6bfc6-8e86-4bd3-86b4-925b60461fa1 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:20.471315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6bfc6-8e86-4bd3-86b4-925b60461fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:20.471445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6bfc6-8e86-4bd3-86b4-925b60461fa1 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:20.473139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 603/1193] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:53:20.478407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:20.478787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:20.478956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:20.495303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:53:20.496520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:53:20.558242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 591/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:53:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:53:20.582302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6bfc6-8e86-4bd3-86b4-925b60461fa1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:20.676341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6bfc6-8e86-4bd3-86b4-925b60461fa1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:20.708280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:20.708992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:20.709272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:20.709543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:20.719563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:53:20.726311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:53:20.727452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 604/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:53:20.733296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:20.824039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef696c27-7157-48f5-bb97-61ee369a75b3 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:20.855595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:20.856242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:20.856516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:20.856784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:20.857509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:20.857809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:20.859189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:20.866701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 592/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:53:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:53:20.872305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:20.964937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3e84c-29ca-47bb-981b-440887ce8644 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:20.995902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:20.996738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:20.997020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:20.997296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] PATH_INFO: `/v3/users/c4c146423ec3470aaf482f7786fd20d9` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:20.998478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] RBAC: Authorizing `identity:get_user(user_id=c4c146423ec3470aaf482f7786fd20d9)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:20.999882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:21.002016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 605/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Tue Apr 26 13:53:20 2022] GET /identity/v3/users/c4c146423ec3470aaf482f7786fd20d9 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:21.007601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:21.101281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf415e-76fb-486f-bf56-17fa26514bee None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:21.132133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:21.132761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:21.133043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:21.133317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:21.196340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:21.197779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:21.288379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 593/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:53:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:53:21.294088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:21.385987 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9e438-e18f-4d84-819f-8a1a1ba54b5b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:21.416704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8c943-c3e7-40c0-aecd-1a75255987b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:21.417527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c943-c3e7-40c0-aecd-1a75255987b2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:21.417809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c943-c3e7-40c0-aecd-1a75255987b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:21.418114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c943-c3e7-40c0-aecd-1a75255987b2 None admin] PATH_INFO: `/v3/projects/ef9308fffd2646039fcd61ae55830c82` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:21.419267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8c943-c3e7-40c0-aecd-1a75255987b2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef9308fffd2646039fcd61ae55830c82)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:21.420672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8c943-c3e7-40c0-aecd-1a75255987b2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:21.422849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 606/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Tue Apr 26 13:53:21 2022] GET /identity/v3/projects/ef9308fffd2646039fcd61ae55830c82 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:53:21.428629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:53:21.520187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9cb7-bba5-413c-bbfc-225e2add627f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:53:21.551902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:53:21.552493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:53:21.552777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:53:21.553052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:53:21.553863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=ef9308fffd2646039fcd61ae55830c82, user.id=c4c146423ec3470aaf482f7786fd20d9) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:53:21.554207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:53:21.555631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7617aa-64a1-4b7e-986d-2b03db413cb3 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:53:21.561072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 594/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:53:21 2022] GET /identity/v3/role_assignments?user.id=c4c146423ec3470aaf482f7786fd20d9&scope.project.id=ef9308fffd2646039fcd61ae55830c82&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:39.106397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d5a0-d68b-42b8-a821-bc89de96f31c None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:39.106989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d5a0-d68b-42b8-a821-bc89de96f31c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:39.106989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d5a0-d68b-42b8-a821-bc89de96f31c None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:39.109372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 607/1201] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:54:39.114527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:39.115013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:39.115116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:39.131433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:54:39.132607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:54:39.195060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 595/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:54:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:54:39.219267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1d5a0-d68b-42b8-a821-bc89de96f31c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:39.316178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1d5a0-d68b-42b8-a821-bc89de96f31c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:39.348825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:39.349619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:39.349893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:39.350203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:39.359871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:39.361311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:39.378447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:39.379604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 608/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:39.385588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:39.479689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128b7e6-d44a-4114-8ba4-0f9a590978aa None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:39.510931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:39.511689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:39.511984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:39.512250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:39.512974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:39.513273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:39.515209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c46f59-56cb-490f-94f2-bcc21fed80f5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:39.526286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 596/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:39.532681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:39.627248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6b79e-beda-452d-821b-89986ff81be2 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:39.658880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452e76b-5b6a-4df5-81ac-5ecb39dcaa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:39.659535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e76b-5b6a-4df5-81ac-5ecb39dcaa0a None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:39.659820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e76b-5b6a-4df5-81ac-5ecb39dcaa0a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:39.660096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452e76b-5b6a-4df5-81ac-5ecb39dcaa0a None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:39.660789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e76b-5b6a-4df5-81ac-5ecb39dcaa0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:39.662497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452e76b-5b6a-4df5-81ac-5ecb39dcaa0a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:39.781191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 609/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Tue Apr 26 13:54:39 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:54:42.073769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893aed-0750-4017-869e-af15482ce576 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.074344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893aed-0750-4017-869e-af15482ce576 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.074344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893aed-0750-4017-869e-af15482ce576 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.076175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 597/1206] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:54:42.082059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.082470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.082612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.099104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:54:42.100304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:54:42.163695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 610/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:54:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:54:42.187067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893aed-0750-4017-869e-af15482ce576 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:42.282849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893aed-0750-4017-869e-af15482ce576 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:42.315417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:42.316208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.316492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.316768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.326858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:54:42.333896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:54:42.334994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 598/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:54:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:42.340975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:42.434327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a4ce1-da36-4412-a310-773722eef483 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:42.467471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:42.468137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.468422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.468700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.469457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:42.469782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:42.471260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:42.478923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 611/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:54:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:42.485301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:42.581257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a55c8-c3b1-4923-879c-49c3bd3ae37c None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:42.613688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:42.614514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.614797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.615074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.625155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:42.626649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:42.643049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:42.644209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 599/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 26 13:54:42.650136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:42.745985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e67735-2978-41ae-abab-c71ad213e2f1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:42.777715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:42.778407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.778695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.778974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.780251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:42.780570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:42.781915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:42.793443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 612/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:42.799800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:42.893932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443527e-fe4a-498b-8f34-34c847c06995 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:42.927289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:42.928089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:42.928374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:42.928652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:42.935743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:42.937180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:42.950780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 26 13:54:42.952007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 600/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:42.957796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:43.053785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952690d-0ccd-41a8-b32c-c08f0ae45e71 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:43.086099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:43.086766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:43.087053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:43.087331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:43.088189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:43.088519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:43.089939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:43.107777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 613/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 26 13:54:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:43.113542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:43.206816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f39764-babd-4cca-a07e-dd86a20296bc None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:43.238921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:43.239559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:43.239838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:43.240131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:43.304272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:43.305736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:43.398451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 601/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:54:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:54:43.404252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:43.501097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0bdf3-58f2-489d-b303-9cf8b1a6156b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:43.533766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:43.534581 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:43.534861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:43.535129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:43.545086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:43.546558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:43.563413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:43.564573 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 614/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:43.570326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:43.665357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed4b04-2af7-40f0-93c8-ee1673c44702 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:43.698049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:43.698705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:43.698989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:43.699264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:43.699979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:43.700283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:43.702272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:43.712867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 602/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:54:43.718662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:43.818685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94d5be-0ed2-4a7e-b7d6-902220b7cf38 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:43.850158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:43.850931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:43.851219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:43.851534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:43.858384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:43.859843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:43.872759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:54:43.874665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 615/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:54:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:43.880658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:44.094259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727dfc2-cf1c-4401-9019-accb17630f71 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:44.126470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:44.127146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:44.127426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:44.127696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:44.128472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:44.128770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:44.130200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047fc5-e759-4da7-8c9f-310fe3837e70 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:44.141018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 603/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:54:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:44.147207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:44.243370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2babff-adcb-4a11-97b8-923f90fe9a53 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:44.274837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:44.275479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:44.275761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:44.276035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:44.276853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=952f39b205c74255a2776e7fec3b8643) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:44.277161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:44.278618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910a6dbf-9e7a-4092-b985-1bca8d532f54 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:44.284549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 616/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:54:44 2022] GET /identity/v3/role_assignments?user.id=952f39b205c74255a2776e7fec3b8643&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:46.528727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9010c89-31ef-418e-bb2c-758623da05df None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:46.529274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9010c89-31ef-418e-bb2c-758623da05df None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:46.529274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9010c89-31ef-418e-bb2c-758623da05df None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:46.531637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 604/1220] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:54:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:54:46.536880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:46.537563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:46.537740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:46.555150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:54:46.556570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:54:46.619229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 617/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:54:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:54:46.641529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9010c89-31ef-418e-bb2c-758623da05df None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:46.736511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9010c89-31ef-418e-bb2c-758623da05df None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:46.772986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:46.773807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:46.774121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:46.774397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:46.784580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:54:46.791781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:54:46.792972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 605/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:54:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:46.799701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:46.894430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882df039-4aa3-4e05-aef5-4dde5740ab28 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:46.928417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:46.929137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:46.929418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:46.929690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:46.930482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:46.930784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:46.932135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:46.940036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 618/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:54:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:46.945867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.041226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaf80c-0e5a-46c1-9b9e-be3776eba3c2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:47.072658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:47.073433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:47.073715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:47.074006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:47.084234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:47.085711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:47.103436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:47.104659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 606/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:47.110464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.206988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c47c1-1373-4691-a784-751d841824f0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:47.238530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:47.239222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:47.239509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:47.239787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:47.240563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:47.240869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:47.242247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:47.254114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 619/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:47.259881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.355219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96e113-afcd-4c82-b43e-d9d049816daa None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:47.386833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:47.387667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:47.387988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:47.388261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:47.395514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:47.398974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:47.411167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 26 13:54:47.412617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 607/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:47.418729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.517001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ddf346-1977-4fe7-8c94-2ed5bf9ba74c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:47.549849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:47.550552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:47.550842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:47.551126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:47.551957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:47.552274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:47.553692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:47.570706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 620/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 26 13:54:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:47.576488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.669147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f9066-c1a1-4cfd-b217-f2310a7da78f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:47.700837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:47.701666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:47.702397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:47.702397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:47.714090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:47.715617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:47.732295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:47.734018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 608/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:47.739923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.837401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25f96e-3a3c-42e0-ad55-61341f29387a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:47.869435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:47.870111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:47.874473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:47.874473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:47.874473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:47.874473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:47.874473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:47.884609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 621/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:47.890336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:47.984370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635ee34-fc96-4f10-9ea5-9efb8bfdb67d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:48.018088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:48.019266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:48.019737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:48.020151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:48.028897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:48.031459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:48.045836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:54:48.047019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 609/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:54:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:48.052818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:48.151033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6e70a-649f-45d4-91bb-69d86ad9514a None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:48.183922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:48.184573 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:48.184859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:48.185138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:48.185919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:48.186260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:48.187688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388ac0e-4e3c-4b2d-8a46-3bbf4a41ddf7 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:48.199039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 622/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:54:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:48.204956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:48.300157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a4cb0-ed57-48db-ae35-91b6e816ce05 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:48.333526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319d1c6-7e6f-4b25-8e8d-0aabfc062ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:48.334905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319d1c6-7e6f-4b25-8e8d-0aabfc062ac8 None admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:48.335363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319d1c6-7e6f-4b25-8e8d-0aabfc062ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:48.335827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319d1c6-7e6f-4b25-8e8d-0aabfc062ac8 None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/952f39b205c74255a2776e7fec3b8643/roles/9317c68e1e944d86b668333be048d093` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:48.353124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319d1c6-7e6f-4b25-8e8d-0aabfc062ac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=952f39b205c74255a2776e7fec3b8643, role_id=9317c68e1e944d86b668333be048d093)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:48.354627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319d1c6-7e6f-4b25-8e8d-0aabfc062ac8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:48.435689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 610/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:54:48 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/952f39b205c74255a2776e7fec3b8643/roles/9317c68e1e944d86b668333be048d093 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:54:50.669300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6574952-a9d3-406d-8c52-e9692e1b9e1b None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:50.669865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6574952-a9d3-406d-8c52-e9692e1b9e1b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:50.669865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6574952-a9d3-406d-8c52-e9692e1b9e1b None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:50.671713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 623/1233] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:54:50.676911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:50.677313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:50.677470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:50.701679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:54:50.701679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:54:50.758473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 611/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:54:50.782541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6574952-a9d3-406d-8c52-e9692e1b9e1b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:50.879924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6574952-a9d3-406d-8c52-e9692e1b9e1b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:50.912348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:50.913136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:50.913411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:50.913684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:50.923776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:54:50.930534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 26 13:54:50.931692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 624/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Tue Apr 26 13:54:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:50.938340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:51.030557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce352b-c727-4b05-a0e2-d608da0a661f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:51.062720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:51.063376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:51.066071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:51.066071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:51.066071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:51.066071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:51.066464 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:51.074345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 612/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Tue Apr 26 13:54:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:51.080606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:51.175206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1776bf-f77a-428b-833c-be5f13858a61 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:51.208300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:51.209136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:51.209399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:51.209675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:51.219357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:51.220779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:51.236930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:51.238102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 625/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:51.243879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:51.338441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ebf9-5757-4350-aa3b-50346ef00da1 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:51.369568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:51.370245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:51.370529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:51.370803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:51.371518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:51.371822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:51.373707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:51.384681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 613/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:51.390578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:51.499249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d6400-d71c-4f50-aac2-29551cfd3e7f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:51.530806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:51.531593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:51.531880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:51.532168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:51.539574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:51.540999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:51.554689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 26 13:54:51.559461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 626/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:51.562369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:51.655309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c8e9a-f459-42b4-b573-598c5816d91f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:51.688150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:51.688812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:51.689090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:51.689360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:51.690207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:51.690515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:51.692008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:51.708609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 614/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 26 13:54:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:51.714288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:51.812547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b1644-3991-45d9-add7-4e70fada5b75 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:51.844495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:51.845139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:51.845428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:51.845707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:51.909649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:51.911133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:52.005701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 627/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:54:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:54:52.011586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:52.106155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717315e9-9d96-4e0d-9e8d-5387069441ea None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:52.137239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:52.138042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:52.138324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:52.139086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:52.148541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:52.149998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:52.167506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:52.168624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 615/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:52.174491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:52.269759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c1fc50-c5b5-43c9-9260-be0c6fdb852c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:52.302568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:52.303232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:52.303513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:52.303787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:52.304505 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:52.304811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:52.306194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:52.316919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 628/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:52.322656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:52.417199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc1cee-d38a-41a2-b1ea-d445df65b647 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:52.449529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:52.450362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:52.450643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:52.450914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:52.457836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:52.459399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:52.472001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:54:52.473183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 616/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:54:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:52.479100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:52.575104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f32371-c069-408e-ae8c-783ae24211fc None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:52.608262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:52.616627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:52.616627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:52.616627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:52.616627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:52.616627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:52.616627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbcc9d-82d9-43f0-ad8a-315d47db8e6f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:52.624855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 629/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:54:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:52.630953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:52.725067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b50a8-282d-4782-afff-5253cf594e90 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:52.756400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:52.757235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:52.757608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:52.757875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:52.758712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] RBAC: Adding query filter params (role.id=9317c68e1e944d86b668333be048d093, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=952f39b205c74255a2776e7fec3b8643) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:52.759012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:52.760408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e23a11-115c-4f24-9719-db4122a6903b None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:52.766577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 617/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:54:52 2022] GET /identity/v3/role_assignments?user.id=952f39b205c74255a2776e7fec3b8643&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=9317c68e1e944d86b668333be048d093 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 13:54:55.088426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d27d2-79cd-4c78-b662-ff7602c5bc02 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.088959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d27d2-79cd-4c78-b662-ff7602c5bc02 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.088959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d27d2-79cd-4c78-b662-ff7602c5bc02 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.090788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 630/1247] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:54:55.096246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.096680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.096802 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.113556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:54:55.114795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:54:55.178258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 618/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:54:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:54:55.201913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d27d2-79cd-4c78-b662-ff7602c5bc02 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:55.298722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d27d2-79cd-4c78-b662-ff7602c5bc02 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:55.331815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:55.332597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.332883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.333180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.343054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:54:55.350013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:54:55.351229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 631/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:55.357881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:55.451177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f793a-c23c-4718-a183-3b5ae5000677 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:55.487976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:55.488631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.488907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.489178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.489906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:55.490237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:55.491597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:55.499261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 619/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:55.504958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:55.601999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deda914-9966-44e6-bd63-4f476aea8b25 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:55.633995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:55.634794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.635078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.635356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.645373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:55.646839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:55.663161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:55.664308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 632/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:55.670747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:55.768968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83329426-c20c-410a-85cb-f4a2b2852cd5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:55.801706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:55.802418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.802663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.802932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.803629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:55.803926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:55.805311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:55.817386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 620/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:55.823127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:55.920437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9edf90-158b-439a-aee8-129ec07f8396 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:55.951973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:55.952764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:55.953046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:55.953321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:55.960529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:55.970084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:55.975887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 26 13:54:55.977047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 633/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:55.982949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:56.074529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71485880-8ec1-4eba-9fc5-e23d1297e591 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:56.107409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:56.108062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:56.108411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:56.108687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:56.109495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:56.109791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:56.111225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:56.127161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 621/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 26 13:54:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:56.132838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:56.227871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594428c-3e70-48b4-98e9-0eb2d4960d34 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:56.259586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:56.260230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:56.260513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:56.260792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:56.325523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:56.327627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:56.419518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 634/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:54:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:54:56.425414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:56.519814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90579b-4058-4859-bdad-b416142163fa None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:56.551608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:56.552388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:56.552665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:56.552934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:56.562847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:56.564276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:56.580169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:56.581302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 622/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:56.587246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:56.681175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cbd80-dae1-414b-9533-103a97b25319 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:56.713658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:56.714333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:56.714617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:56.714892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:56.715634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:56.715937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:56.717552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:56.728340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 635/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:56.734761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:56.830102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d993f2-ed4a-4e13-978e-978b7a7dea6f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:56.862142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:56.862924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:56.863201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:56.863475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:56.869848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:56.871345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:56.884415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:54:56.885553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 623/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:54:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:56.891622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:56.986579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f8f58-f619-497f-90c6-67820e82321f None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:57.018019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:57.018665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:57.018945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:57.019220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:57.020045 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:57.020348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:57.021747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031df6b4-a762-41ec-a2fd-646e3b5b94ea None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:57.033593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 636/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:54:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:57.039893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:57.134413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea61e5-8c50-4271-9410-4ae931092b46 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:57.166303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:57.166948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:57.167228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:57.167551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:57.168353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=952f39b205c74255a2776e7fec3b8643) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:57.168661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:57.170717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d81b3-d810-4c1b-8442-b15caa0cfff6 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:57.175868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 624/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:54:57 2022] GET /identity/v3/role_assignments?user.id=952f39b205c74255a2776e7fec3b8643&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:59.423117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c679-77ac-403b-beff-5b8c00b2dfbb None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:59.423675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c679-77ac-403b-beff-5b8c00b2dfbb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:59.423675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c679-77ac-403b-beff-5b8c00b2dfbb None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:59.425456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 637/1261] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:54:59.430603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:59.431034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:59.432999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:59.448357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:54:59.449526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:54:59.513084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 625/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:54:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:54:59.535893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c679-77ac-403b-beff-5b8c00b2dfbb None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:59.634205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263c679-77ac-403b-beff-5b8c00b2dfbb None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:59.666844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:59.667616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:59.667897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:59.668167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:59.678283 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:54:59.684625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:54:59.685813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 638/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:54:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:54:59.691930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:59.784985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddab44b-dc39-4fb1-801b-7bf6ac266f0a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:59.817440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:59.818119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:59.818397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:59.818667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:59.819570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:54:59.819868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:59.821220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:59.829587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 626/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:54:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:54:59.835479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:54:59.932675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285bd97-5409-4c1c-8ecd-7070e279194b None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:54:59.964915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:54:59.965783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:54:59.966094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:54:59.966418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:54:59.976538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:54:59.978595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:54:59.994471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:54:59.995633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 639/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:54:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:00.001916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:00.094701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564fb57-4f7e-4b11-bd64-1dc2ee5205ed None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:00.127707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:00.128361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:00.128644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:00.128919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:00.129639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:00.129944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:00.131344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:00.143196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 627/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:00.148909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:00.243404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b536d08-f231-4ead-ab0f-07db30fd7d79 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:00.276340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:00.277132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:00.277415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:00.277692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:00.284948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:00.286472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:00.300441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 26 13:55:00.301585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 640/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:00.307379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:00.399991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7848b-6e69-4bd6-ae9b-4452e07790c2 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:00.432310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:00.432977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:00.433258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:00.433533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:00.434427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:00.434734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:00.436786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:00.454403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 628/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:00.459913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:00.558437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df655b88-2d34-459f-aeb1-bedaef818ae0 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:00.590760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:00.591621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:00.591905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:00.592180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:00.602344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:00.603767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:00.625641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:55:00.626863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 641/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:00.632696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:00.726124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea769b8e-4a81-411e-b0a0-6e7207bfb371 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:00.758783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:00.759449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:00.759828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:00.760106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:00.760832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:00.761136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:00.762562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:00.774266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 629/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:00.780823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:00.878877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f882-d298-40c2-8a0d-b6500b85d019 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:00.911016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:00.911794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:00.912326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:00.912611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:00.918996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:00.921005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:00.934068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:55:00.935741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 642/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:00.941697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:01.035192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1b9ec-d444-4920-b4b4-ac94fee2cf4f None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:01.068043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:01.068699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:01.068979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:01.069254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:01.070063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:01.070410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:01.071785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33200668-1f8a-43ec-b2b8-79cffa8760a4 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:01.083423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 630/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:55:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:01.089512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:01.183828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf654388-2b2f-47a5-b641-14fd6434c6c3 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:01.215641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f3a52-7bdc-49a4-af39-6fb3df14648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:01.216529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f3a52-7bdc-49a4-af39-6fb3df14648d None admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:01.216813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f3a52-7bdc-49a4-af39-6fb3df14648d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:01.217087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f3a52-7bdc-49a4-af39-6fb3df14648d None admin] PATH_INFO: `/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/952f39b205c74255a2776e7fec3b8643/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:01.219220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f3a52-7bdc-49a4-af39-6fb3df14648d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8965b215ec64df5bb4bc3c9d91922e5, user_id=952f39b205c74255a2776e7fec3b8643, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:01.220520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f3a52-7bdc-49a4-af39-6fb3df14648d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:01.300933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 643/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Tue Apr 26 13:55:01 2022] PUT /identity/v3/projects/e8965b215ec64df5bb4bc3c9d91922e5/users/952f39b205c74255a2776e7fec3b8643/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 13:55:03.552425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a1d0-8639-407f-90c0-8e2542ee1f27 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:03.552993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a1d0-8639-407f-90c0-8e2542ee1f27 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:03.552993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2a1d0-8639-407f-90c0-8e2542ee1f27 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:03.554986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 631/1274] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:55:03.560236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225611-4271-46b8-8eed-6d474adee174 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:03.560654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225611-4271-46b8-8eed-6d474adee174 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:03.560790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87225611-4271-46b8-8eed-6d474adee174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:03.577986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-87225611-4271-46b8-8eed-6d474adee174 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:55:03.579177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-87225611-4271-46b8-8eed-6d474adee174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:55:03.643927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 644/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:55:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:55:03.672513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a1d0-8639-407f-90c0-8e2542ee1f27 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:03.769776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2a1d0-8639-407f-90c0-8e2542ee1f27 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:03.801367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:03.802175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:03.802455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:03.802727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:03.812731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 26 13:55:03.819534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 26 13:55:03.822874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 632/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Tue Apr 26 13:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:03.827196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87225611-4271-46b8-8eed-6d474adee174 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:03.920079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87225611-4271-46b8-8eed-6d474adee174 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:03.952824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:03.953486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:03.953776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:03.954089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:03.954837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:03.955145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:03.956543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:03.964332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 645/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Tue Apr 26 13:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:03.970015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:04.063598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4feb166-0e21-479e-9d3c-3d5c8e3ab7a5 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:04.094234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:04.095008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:04.095291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:04.095563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:04.105429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:04.107478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:04.123580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:55:04.124707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 633/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:55:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:04.130388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:04.226401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb5ff-d61a-4824-b6ac-19c3c78fd50c None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:04.258769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:04.259459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:04.259741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:04.260015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:04.260726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:04.261031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:04.262422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:04.277861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 646/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:04.279105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:04.373454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a381e5-8b37-4049-95c8-30f9a8075752 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:04.404234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:04.405015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:04.405358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:04.405634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:04.412942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:04.414436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:04.428140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 26 13:55:04.429276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 634/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:55:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:04.435593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:04.530378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddeae01-9168-4906-a1ec-278f014ae1ce None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:04.564112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:04.564777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:04.565065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:04.565348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:04.566208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:04.566524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:04.567925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:04.584159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 647/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Tue Apr 26 13:55:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:04.590091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:04.687054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2141c3-d5ee-4e03-84b6-255d51b00298 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:04.718551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:04.719183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:04.719459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:04.719725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:04.782706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:04.784180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:04.878932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 635/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Tue Apr 26 13:55:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 26 13:55:04.884664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:04.978323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90715ceb-8847-445c-96d7-6e99ad4e8f04 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:05.011619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:05.012403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:05.012687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:05.012984 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:05.022626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:05.025036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:05.040657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 26 13:55:05.041809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 648/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 13:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:05.047994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:05.150860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69d07e-d4b6-4d70-9564-cab5b3b98157 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:05.187411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:05.188109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:05.188386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:05.188653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:05.189408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:05.189709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:05.191233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:05.203715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 636/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Tue Apr 26 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:05.209540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:05.313136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428670-7f9a-44ee-bba7-2483f88f15c5 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:05.350642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:05.351448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:05.351731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:05.352008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:05.360176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:05.361772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:05.375443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING keystone.server.flask.application [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 26 13:55:05.376699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 649/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Tue Apr 26 13:55:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:05.382834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:05.484488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344aa24-61e7-4f16-9d67-79068572bfa8 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:05.517814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:05.518507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:05.518796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:05.519069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:05.519887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:05.520201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:05.521623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc137c6d-5cca-44dc-b028-ff018ec3a309 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:05.534275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 637/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Tue Apr 26 13:55:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:05.540709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:05.636506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a990b8-6629-4e4d-a39e-25a2740e95e9 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:05.669689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:05.670719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:05.670719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:05.670962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:05.671826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] RBAC: Adding query filter params (role.id=2cb59225af0e4b48b675859725e6b7d8, scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5, user.id=952f39b205c74255a2776e7fec3b8643) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:05.672140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:05.673567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e6afd-264a-4772-a54b-cd502b42136d None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:05.679352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 650/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Tue Apr 26 13:55:05 2022] GET /identity/v3/role_assignments?user.id=952f39b205c74255a2776e7fec3b8643&scope.project.id=e8965b215ec64df5bb4bc3c9d91922e5&role.id=2cb59225af0e4b48b675859725e6b7d8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:07.977547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9b90-b82b-4229-856e-24298a37a6ec None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:07.978139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9b90-b82b-4229-856e-24298a37a6ec None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:07.978139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c9b90-b82b-4229-856e-24298a37a6ec None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:07.979908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 638/1288] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:55:07.985525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:07.985990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:07.986148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:08.003287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:55:08.004475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:55:08.068739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 651/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:55:08.091876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9b90-b82b-4229-856e-24298a37a6ec None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:08.187021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c9b90-b82b-4229-856e-24298a37a6ec None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:08.218933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:08.219722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:08.220010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:08.220287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:08.220943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:08.222331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:08.233191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 26 13:55:08.234398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 639/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:55:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:08.240342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:08.335243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1601e1-3f41-4d10-8940-d04dc1a43d66 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:08.367797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:08.368447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:08.368732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:08.369007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:08.369705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:08.370033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:08.371383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf456b-6b6a-47ca-8df9-ceeea78e0af6 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:08.376582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 652/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 26 13:55:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:08.382325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:08.477247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228edd2-89b1-4c7e-b1d3-ce37164f5603 None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:08.508595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:08.509313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:08.509590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:08.509860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] PATH_INFO: `/v3/services` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:08.510618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:08.510919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:08.512270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71998269-2701-45d8-9a11-b8308e693762 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:08.517034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 640/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 26 13:55:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:10.763374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7a29-c99b-4493-a321-099f7fbeaee1 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:10.763890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7a29-c99b-4493-a321-099f7fbeaee1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:10.763890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c7a29-c99b-4493-a321-099f7fbeaee1 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:10.765720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 653/1293] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:55:10.771200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c581b-673b-4009-add3-7f42bbc1e6b1 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:10.771615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c581b-673b-4009-add3-7f42bbc1e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:10.771790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c581b-673b-4009-add3-7f42bbc1e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:10.789463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6c6c581b-673b-4009-add3-7f42bbc1e6b1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:55:10.790701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6c6c581b-673b-4009-add3-7f42bbc1e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:55:10.854410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 641/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:55:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:55:10.876551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7a29-c99b-4493-a321-099f7fbeaee1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:10.974842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c7a29-c99b-4493-a321-099f7fbeaee1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:11.006768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9190587-71b5-488f-a62c-30f73f409777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:11.007423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9190587-71b5-488f-a62c-30f73f409777 None admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:11.007709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9190587-71b5-488f-a62c-30f73f409777 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:11.007986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9190587-71b5-488f-a62c-30f73f409777 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:11.008740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9190587-71b5-488f-a62c-30f73f409777 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:11.010132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9190587-71b5-488f-a62c-30f73f409777 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:11.112599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 654/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Tue Apr 26 13:55:10 2022] POST /identity/v3/services => generated 246 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 13:55:13.375312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585875da-d666-4ea2-87aa-e01b58c7b438 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:13.375907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585875da-d666-4ea2-87aa-e01b58c7b438 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:13.375907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585875da-d666-4ea2-87aa-e01b58c7b438 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:13.377657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 642/1296] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:55:13.382715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:13.383145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:13.383369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:13.399792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:55:13.400971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:55:13.472303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 655/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:55:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:55:13.495071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585875da-d666-4ea2-87aa-e01b58c7b438 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:13.592858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585875da-d666-4ea2-87aa-e01b58c7b438 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:13.624791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:13.625612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:13.625870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:13.626168 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:13.626801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:13.628150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:13.638783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 26 13:55:13.639907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 643/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:55:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:13.645925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:13.740099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e418c-81e8-4541-9073-1b29f8bc6d2d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:13.771653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:13.772301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:13.772584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:13.772866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:13.773569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:13.773874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:13.775266 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:13.780812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 656/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 26 13:55:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:13.786797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:13.880383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195ce29-418a-4e24-8bc5-4daa6be5993a None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:13.912503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:13.913145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:13.913426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:13.913722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:13.914539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] RBAC: Adding query filter params (interface=public, service_id=481d5beaebc643448035dd081193feae, region_id=RegionOne) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:13.914843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:13.916196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671cf97-49e7-4250-ac29-dfebfa55f7b2 None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:13.920945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 644/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Tue Apr 26 13:55:13 2022] GET /identity/v3/endpoints?service_id=481d5beaebc643448035dd081193feae&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:13.926497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:14.022154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380066bd-6adf-4537-9cd3-bddcb019ffd1 None admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:14.054368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d153e1-c48b-41f4-9aa6-38693d5e21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:14.055020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d153e1-c48b-41f4-9aa6-38693d5e21c9 None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:14.055306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d153e1-c48b-41f4-9aa6-38693d5e21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:14.055578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d153e1-c48b-41f4-9aa6-38693d5e21c9 None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:14.056258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d153e1-c48b-41f4-9aa6-38693d5e21c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:14.057606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d153e1-c48b-41f4-9aa6-38693d5e21c9 None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:14.064195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 657/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Tue Apr 26 13:55:13 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 13:55:16.335022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc4e29-febf-4095-a992-b196210f0730 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:16.335614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc4e29-febf-4095-a992-b196210f0730 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:16.335614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc4e29-febf-4095-a992-b196210f0730 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:16.337363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 645/1302] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 13:55:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 13:55:16.342571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:16.343115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:16.343115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:16.360370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 13:55:16.361550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 13:55:16.424637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 658/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 13:55:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 26 13:55:16.448179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc4e29-febf-4095-a992-b196210f0730 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:16.545945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc4e29-febf-4095-a992-b196210f0730 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:16.577512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:16.578388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:16.578668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:16.578934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:16.579565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:16.580992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:16.592350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING keystone.server.flask.application [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 26 13:55:16.593443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 646/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Tue Apr 26 13:55:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 26 13:55:16.599641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:16.694259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a87931-37ab-41fa-b1dc-156f3524e191 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:16.728358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:16.729129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:16.729413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:16.729689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] PATH_INFO: `/v3/services` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:16.730434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 13:55:16.730742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:16.732701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539791a7-d93a-48d5-ab18-e196b856273c None admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:16.737727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 659/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Tue Apr 26 13:55:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 13:55:16.743521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 13:55:16.837277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc99f9-8ba5-44b4-a726-50ee20081a2d None admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 13:55:16.868803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ca921-41a2-4d68-b2f7-4442cd4da99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 13:55:16.869396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ca921-41a2-4d68-b2f7-4442cd4da99e None admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 13:55:16.869678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ca921-41a2-4d68-b2f7-4442cd4da99e None admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 13:55:16.869950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ca921-41a2-4d68-b2f7-4442cd4da99e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 13:55:16.870706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ca921-41a2-4d68-b2f7-4442cd4da99e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 13:55:16.872069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ca921-41a2-4d68-b2f7-4442cd4da99e None admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 13:55:16.940492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 647/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Tue Apr 26 13:55:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:01:29.348248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8528-4f37-4767-8459-78dfc896396e None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:29.349615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8528-4f37-4767-8459-78dfc896396e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:29.350488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f8528-4f37-4767-8459-78dfc896396e None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:29.356458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 660/1307] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:29.361154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa775b-c635-402c-8416-a8d21b816cce None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:29.362377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa775b-c635-402c-8416-a8d21b816cce None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:29.363253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa775b-c635-402c-8416-a8d21b816cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:29.450987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-09fa775b-c635-402c-8416-a8d21b816cce None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:29.452252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-09fa775b-c635-402c-8416-a8d21b816cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:29.575157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 648/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:29.583023 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8528-4f37-4767-8459-78dfc896396e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:29.585272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9c0f8528-4f37-4767-8459-78dfc896396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:29.745553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f8528-4f37-4767-8459-78dfc896396e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:29.839765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:29.840650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:29.840941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:29.841218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:29.842892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:29.844612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:01:29.844612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:01:29.844612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:01:29.845936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769c550-3ff4-4dc5-8c1d-f59f87c0fdcd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:29.871353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 661/1309] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 14:01:29 2022] GET /identity/v3/projects => generated 2553 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:01:32.227503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a16e-c07b-4e99-abe0-0d5e18b21feb None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:32.228120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a16e-c07b-4e99-abe0-0d5e18b21feb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:32.228120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a16e-c07b-4e99-abe0-0d5e18b21feb None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:32.230235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 649/1310] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:32.236533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c83-856b-439d-accc-aa0a8530b238 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:32.236943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c83-856b-439d-accc-aa0a8530b238 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:32.237089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4569c83-856b-439d-accc-aa0a8530b238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:32.335034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b4569c83-856b-439d-accc-aa0a8530b238 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:32.336634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b4569c83-856b-439d-accc-aa0a8530b238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:32.451306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 662/1311] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:32.501003 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f314-5c33-424a-b047-4c5477a2e454 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:32.501295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f314-5c33-424a-b047-4c5477a2e454 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:32.501583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367f314-5c33-424a-b047-4c5477a2e454 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:32.503424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 650/1312] 10.222.0.23 () {54 vars in 963 bytes} [Tue Apr 26 14:01:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:32.509709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0304-4c47-422d-980d-dda20c88f4fc None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:32.510045 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0304-4c47-422d-980d-dda20c88f4fc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:32.510333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a0304-4c47-422d-980d-dda20c88f4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:32.592054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-4a9a0304-4c47-422d-980d-dda20c88f4fc None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:32.593398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4a9a0304-4c47-422d-980d-dda20c88f4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:32.670124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 663/1313] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Apr 26 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:32.678692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f314-5c33-424a-b047-4c5477a2e454 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:32.680242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6367f314-5c33-424a-b047-4c5477a2e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:32.785798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367f314-5c33-424a-b047-4c5477a2e454 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:32.860611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:32.861367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:32.861756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:32.862200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:32.863935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:32.974759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:32.976279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e44ad-c96e-4ccf-89c0-26c6e76a3ae8 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:32.994724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 651/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:01:35.571507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d97e-2692-486d-9745-26f7c2f63e6a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:35.572028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d97e-2692-486d-9745-26f7c2f63e6a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:35.572144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165d97e-2692-486d-9745-26f7c2f63e6a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:35.573869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 664/1315] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:35.579635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732740-dc65-45fa-b321-f2cc7b3004c2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:35.580067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732740-dc65-45fa-b321-f2cc7b3004c2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:35.580186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732740-dc65-45fa-b321-f2cc7b3004c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:35.641613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ef732740-dc65-45fa-b321-f2cc7b3004c2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:35.642829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ef732740-dc65-45fa-b321-f2cc7b3004c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:35.732962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 652/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:35.771651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d97e-2692-486d-9745-26f7c2f63e6a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:35.773183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1165d97e-2692-486d-9745-26f7c2f63e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:35.894742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165d97e-2692-486d-9745-26f7c2f63e6a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:35.963636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:35.964274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:35.964553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:35.964825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:35.966492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:36.069042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:36.070417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da78d90-e325-4f2d-8510-7b9536b29ea7 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:36.087711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 665/1317] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:38.873100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109b72-e97b-4af8-8503-10dfd8fe6a3e None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:38.873643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109b72-e97b-4af8-8503-10dfd8fe6a3e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:38.873643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109b72-e97b-4af8-8503-10dfd8fe6a3e None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:38.875481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 653/1318] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:38.880788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d876c2-464d-488d-be8e-7c99e29457bf None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:38.881203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d876c2-464d-488d-be8e-7c99e29457bf None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:38.881346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d876c2-464d-488d-be8e-7c99e29457bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:38.944832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d5d876c2-464d-488d-be8e-7c99e29457bf None None] MFA Rules not processed for user `2ea08e8a2d62450da554d5efd8fe752c`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:38.946058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d5d876c2-464d-488d-be8e-7c99e29457bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:39.039382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 666/1319] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:39.095928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b693f-49c3-4933-9756-aa3fcedc3720 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:39.096070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b693f-49c3-4933-9756-aa3fcedc3720 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:39.096432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b693f-49c3-4933-9756-aa3fcedc3720 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:39.098182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 654/1320] 10.222.0.23 () {54 vars in 963 bytes} [Tue Apr 26 14:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:39.104269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297a9ff-cac3-4885-a3ba-4cff01c5402d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:39.106080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297a9ff-cac3-4885-a3ba-4cff01c5402d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:39.106080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297a9ff-cac3-4885-a3ba-4cff01c5402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:39.176143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7297a9ff-cac3-4885-a3ba-4cff01c5402d None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:39.177308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7297a9ff-cac3-4885-a3ba-4cff01c5402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:39.249630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 667/1321] 10.222.0.23 () {58 vars in 1060 bytes} [Tue Apr 26 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:39.258672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b693f-49c3-4933-9756-aa3fcedc3720 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:39.260189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c84b693f-49c3-4933-9756-aa3fcedc3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:39.359643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b693f-49c3-4933-9756-aa3fcedc3720 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:39.428058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:39.428627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:39.428910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:39.429185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:39.430808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:39.534178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:39.535611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d98d859-dfac-4d5a-a747-0219d09ff966 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:39.553429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 655/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:43.065142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029356d9-1485-48e1-ab89-2ca3c384d27f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:43.065812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029356d9-1485-48e1-ab89-2ca3c384d27f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:43.065812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029356d9-1485-48e1-ab89-2ca3c384d27f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:43.067577 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 668/1323] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:43.073177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642869-1f32-46d8-844f-bd7a92e7933c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:43.073621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642869-1f32-46d8-844f-bd7a92e7933c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:43.073720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f642869-1f32-46d8-844f-bd7a92e7933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:43.137507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-7f642869-1f32-46d8-844f-bd7a92e7933c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:43.139298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7f642869-1f32-46d8-844f-bd7a92e7933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:43.232815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 656/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:01:43.271252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029356d9-1485-48e1-ab89-2ca3c384d27f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:43.272785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-029356d9-1485-48e1-ab89-2ca3c384d27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:43.371701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029356d9-1485-48e1-ab89-2ca3c384d27f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:43.440594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:43.441290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:43.441513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:43.441789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:43.443462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:43.549903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:43.551353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96522902-a6ed-4c84-b779-630f81711f29 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:43.568998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 669/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:46.788890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4260a-efe8-47f8-acd0-51c91fb931f9 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:46.789412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4260a-efe8-47f8-acd0-51c91fb931f9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:46.789412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4260a-efe8-47f8-acd0-51c91fb931f9 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:46.791169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 657/1326] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:46.796424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b14c-98fd-4659-b415-3050c06c3322 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:46.796841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b14c-98fd-4659-b415-3050c06c3322 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:46.796989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b14c-98fd-4659-b415-3050c06c3322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:46.859992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fd62b14c-98fd-4659-b415-3050c06c3322 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:46.861252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fd62b14c-98fd-4659-b415-3050c06c3322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:46.953055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 670/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:46.988638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4260a-efe8-47f8-acd0-51c91fb931f9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:46.990241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-43b4260a-efe8-47f8-acd0-51c91fb931f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:47.089449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4260a-efe8-47f8-acd0-51c91fb931f9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:47.159997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:47.160650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:47.160933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:47.161211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:47.162927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:47.267948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:47.269387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d93a9-326e-4972-84d4-f1e54bcce599 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:47.286699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 658/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:49.649011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c258a-148f-456e-b36e-959b08068df9 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:49.649675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c258a-148f-456e-b36e-959b08068df9 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:49.649675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c258a-148f-456e-b36e-959b08068df9 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:49.651407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 671/1329] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:49.657220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4346-d564-4dd0-ba6b-b03ba77e5249 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:49.657648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4346-d564-4dd0-ba6b-b03ba77e5249 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:49.657753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa4346-d564-4dd0-ba6b-b03ba77e5249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:49.721771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1aaa4346-d564-4dd0-ba6b-b03ba77e5249 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:49.723144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1aaa4346-d564-4dd0-ba6b-b03ba77e5249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:49.815908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 659/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:01:49.853085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c258a-148f-456e-b36e-959b08068df9 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:49.854678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-241c258a-148f-456e-b36e-959b08068df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:49.957038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c258a-148f-456e-b36e-959b08068df9 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:50.028622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:50.029239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:50.030069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:50.030347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:50.032034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:50.137025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:50.139422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021deefa-9d9f-40e2-96f3-7b39df858ee1 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:50.157942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 672/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:52.503717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6059c-5e26-48f7-84a6-ec84411bb86e None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:52.504262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6059c-5e26-48f7-84a6-ec84411bb86e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:52.504262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6059c-5e26-48f7-84a6-ec84411bb86e None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:52.506051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 660/1332] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:52.511223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f92b-75d1-4eb7-8db0-7c99b4930795 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:52.511618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f92b-75d1-4eb7-8db0-7c99b4930795 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:52.511769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688f92b-75d1-4eb7-8db0-7c99b4930795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:52.576329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c688f92b-75d1-4eb7-8db0-7c99b4930795 None None] MFA Rules not processed for user `2ea08e8a2d62450da554d5efd8fe752c`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:52.577520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c688f92b-75d1-4eb7-8db0-7c99b4930795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:52.673144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 673/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:01:52.713657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6059c-5e26-48f7-84a6-ec84411bb86e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:52.715226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bbd6059c-5e26-48f7-84a6-ec84411bb86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:52.814574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6059c-5e26-48f7-84a6-ec84411bb86e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:52.886266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:52.886910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:52.887186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:52.887455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:52.889619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:52.993684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:52.995061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ec990-1a51-454b-9f56-4e487afb717e service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:53.011865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 661/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:55.739561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155770a-9906-4281-a7ee-4bf8b178e133 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:55.740057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155770a-9906-4281-a7ee-4bf8b178e133 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:55.740057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155770a-9906-4281-a7ee-4bf8b178e133 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:55.741862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 674/1335] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:55.747056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363b17-50e0-4340-9b8b-7965cdb5e68a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:55.747496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363b17-50e0-4340-9b8b-7965cdb5e68a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:55.747599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c363b17-50e0-4340-9b8b-7965cdb5e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:55.809578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4c363b17-50e0-4340-9b8b-7965cdb5e68a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:55.811317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4c363b17-50e0-4340-9b8b-7965cdb5e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:55.910491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 662/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:01:55.946689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155770a-9906-4281-a7ee-4bf8b178e133 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:55.948292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2155770a-9906-4281-a7ee-4bf8b178e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:56.073949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155770a-9906-4281-a7ee-4bf8b178e133 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:56.145651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:56.146331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:56.146612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:56.146883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:56.148505 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:56.256038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:56.257400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dc808-1e03-4eda-8612-b4f8ca51bb78 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:56.280522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 675/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:01:58.619442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4cef5-323b-4584-9144-f214c2f9d4d2 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:58.619995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4cef5-323b-4584-9144-f214c2f9d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:58.619995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4cef5-323b-4584-9144-f214c2f9d4d2 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:58.621776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 663/1338] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:01:58.627177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302edb-b52c-4ed0-9ab7-fbf0270f4f29 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:58.627615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302edb-b52c-4ed0-9ab7-fbf0270f4f29 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:58.627754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65302edb-b52c-4ed0-9ab7-fbf0270f4f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:58.691399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-65302edb-b52c-4ed0-9ab7-fbf0270f4f29 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:01:58.692660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-65302edb-b52c-4ed0-9ab7-fbf0270f4f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:58.786672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 676/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:01:58.826811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4cef5-323b-4584-9144-f214c2f9d4d2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:01:58.828309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-def4cef5-323b-4584-9144-f214c2f9d4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:58.926677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4cef5-323b-4584-9144-f214c2f9d4d2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:01:58.995301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:01:58.995874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:01:58.996156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:01:58.996429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:01:58.998101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:01:59.100553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:01:59.101993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31041973-c304-4f67-bc70-b91557e008ed service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:01:59.119534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 664/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:02.092458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b334-5c00-4bc4-b328-08e3997c9f4e None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:02.092992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b334-5c00-4bc4-b328-08e3997c9f4e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:02.092992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50b334-5c00-4bc4-b328-08e3997c9f4e None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:02.094835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 677/1341] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:02.100110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983027ed-8a3c-4ac0-b8ed-6f69eac7d580 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:02.100540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983027ed-8a3c-4ac0-b8ed-6f69eac7d580 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:02.100634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983027ed-8a3c-4ac0-b8ed-6f69eac7d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:02.169012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-983027ed-8a3c-4ac0-b8ed-6f69eac7d580 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:02.170245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-983027ed-8a3c-4ac0-b8ed-6f69eac7d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:02.270669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 665/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:02.306586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b334-5c00-4bc4-b328-08e3997c9f4e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:02.308731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4c50b334-5c00-4bc4-b328-08e3997c9f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:02.401745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50b334-5c00-4bc4-b328-08e3997c9f4e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:02.405369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b7c7e-6624-4ee7-ba9a-8e43c5f89400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:02.406034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b7c7e-6624-4ee7-ba9a-8e43c5f89400 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:02.406324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b7c7e-6624-4ee7-ba9a-8e43c5f89400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:02.406604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b7c7e-6624-4ee7-ba9a-8e43c5f89400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:02.415820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b7c7e-6624-4ee7-ba9a-8e43c5f89400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:02.417248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b7c7e-6624-4ee7-ba9a-8e43c5f89400 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:02.426744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 678/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:06.915430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da714-680c-4b84-a7ac-aacd523138ea None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:06.915967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da714-680c-4b84-a7ac-aacd523138ea None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:06.915967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9da714-680c-4b84-a7ac-aacd523138ea None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:06.917730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 666/1344] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:06.923209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d86a5-3b83-4e01-8db6-a702fd225b60 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:06.923650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d86a5-3b83-4e01-8db6-a702fd225b60 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:06.923922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d86a5-3b83-4e01-8db6-a702fd225b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:06.954911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8f1d86a5-3b83-4e01-8db6-a702fd225b60 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:06.956154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8f1d86a5-3b83-4e01-8db6-a702fd225b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:07.030170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 679/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:07.068600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9da714-680c-4b84-a7ac-aacd523138ea None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:07.079593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9da714-680c-4b84-a7ac-aacd523138ea None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:07.083107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367e4f-a997-4e6e-bd01-f4a584da8d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:07.083737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367e4f-a997-4e6e-bd01-f4a584da8d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:07.084018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367e4f-a997-4e6e-bd01-f4a584da8d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:07.084292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367e4f-a997-4e6e-bd01-f4a584da8d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:07.092892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367e4f-a997-4e6e-bd01-f4a584da8d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:07.094353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367e4f-a997-4e6e-bd01-f4a584da8d2c service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:07.103534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 667/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:10.252230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0d7c-5442-4826-b53f-3d35bc42722f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:10.252775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0d7c-5442-4826-b53f-3d35bc42722f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:10.252775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0d7c-5442-4826-b53f-3d35bc42722f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:10.254506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 680/1347] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:10.259623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62499-83ab-4e47-ac28-cdb1e15a71ba None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:10.260033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62499-83ab-4e47-ac28-cdb1e15a71ba None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:10.260172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e62499-83ab-4e47-ac28-cdb1e15a71ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:10.277313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-87e62499-83ab-4e47-ac28-cdb1e15a71ba None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:10.278621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-87e62499-83ab-4e47-ac28-cdb1e15a71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:10.286454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 668/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:10.323439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0d7c-5442-4826-b53f-3d35bc42722f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:10.333766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0d7c-5442-4826-b53f-3d35bc42722f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:10.337255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed78c1a-6e4f-46d0-a6dc-12fd1b3720f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:10.337873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed78c1a-6e4f-46d0-a6dc-12fd1b3720f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:10.338185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed78c1a-6e4f-46d0-a6dc-12fd1b3720f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:10.338458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed78c1a-6e4f-46d0-a6dc-12fd1b3720f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:10.347556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed78c1a-6e4f-46d0-a6dc-12fd1b3720f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:10.348974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed78c1a-6e4f-46d0-a6dc-12fd1b3720f8 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:10.359289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 681/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:15.099783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9713de-9b6d-49df-abf5-eda4638b89a6 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:15.100372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9713de-9b6d-49df-abf5-eda4638b89a6 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:15.100372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9713de-9b6d-49df-abf5-eda4638b89a6 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:15.102114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 669/1350] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:15.107400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9128a-5aef-4961-93c7-febb8c9a92a7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:15.107839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9128a-5aef-4961-93c7-febb8c9a92a7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:15.107942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9128a-5aef-4961-93c7-febb8c9a92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:15.127931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-60d9128a-5aef-4961-93c7-febb8c9a92a7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:15.129144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-60d9128a-5aef-4961-93c7-febb8c9a92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:15.142554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 682/1351] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:15.180659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9713de-9b6d-49df-abf5-eda4638b89a6 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:15.192377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9713de-9b6d-49df-abf5-eda4638b89a6 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:15.195940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62932c00-7e27-4a1d-bcbe-3a0e2ff1cc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:15.196578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62932c00-7e27-4a1d-bcbe-3a0e2ff1cc96 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:15.196858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62932c00-7e27-4a1d-bcbe-3a0e2ff1cc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:15.197249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62932c00-7e27-4a1d-bcbe-3a0e2ff1cc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:15.210450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62932c00-7e27-4a1d-bcbe-3a0e2ff1cc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:15.212769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62932c00-7e27-4a1d-bcbe-3a0e2ff1cc96 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:15.224847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 670/1352] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:20.617423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be4ec-043c-471e-9c39-44c2b4deda29 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:20.617924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be4ec-043c-471e-9c39-44c2b4deda29 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:20.618041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be4ec-043c-471e-9c39-44c2b4deda29 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:20.625049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 683/1353] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:02:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:20.643387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693e9e-ef52-441b-98f1-d310fb0b2204 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:20.643860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693e9e-ef52-441b-98f1-d310fb0b2204 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:20.643963 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb693e9e-ef52-441b-98f1-d310fb0b2204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:20.733486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-eb693e9e-ef52-441b-98f1-d310fb0b2204 None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:20.735247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-eb693e9e-ef52-441b-98f1-d310fb0b2204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:20.810957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 671/1354] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:25.309993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dee01-6879-49bc-81eb-f8764861ced6 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:25.309993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dee01-6879-49bc-81eb-f8764861ced6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:25.309993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dee01-6879-49bc-81eb-f8764861ced6 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:25.309993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 684/1355] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:25.315126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc7cbb-9af8-4267-b6f8-42ffa16a3e35 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:25.315531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc7cbb-9af8-4267-b6f8-42ffa16a3e35 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:25.315700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc7cbb-9af8-4267-b6f8-42ffa16a3e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:25.333880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-02dc7cbb-9af8-4267-b6f8-42ffa16a3e35 None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:25.335102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-02dc7cbb-9af8-4267-b6f8-42ffa16a3e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:25.344018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 672/1356] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:26.961356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c9d47-4457-4bcf-8de5-b93368662a36 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:26.961894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c9d47-4457-4bcf-8de5-b93368662a36 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:26.961894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c9d47-4457-4bcf-8de5-b93368662a36 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:26.964008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 685/1357] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:26.970531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effb326-4350-4ded-83d9-4f8767f92876 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:26.971074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effb326-4350-4ded-83d9-4f8767f92876 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:26.971222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effb326-4350-4ded-83d9-4f8767f92876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:26.990315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6effb326-4350-4ded-83d9-4f8767f92876 None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:26.991773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6effb326-4350-4ded-83d9-4f8767f92876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:27.001512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 673/1358] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:30.845494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8a8f6-b02e-47f4-b794-b369a55deabb None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:30.846101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8a8f6-b02e-47f4-b794-b369a55deabb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:30.846319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8a8f6-b02e-47f4-b794-b369a55deabb None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:30.851517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 686/1359] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:30.853424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46050def-6d57-4a00-bd22-24e3ed47a33d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:30.853847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46050def-6d57-4a00-bd22-24e3ed47a33d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:30.854023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46050def-6d57-4a00-bd22-24e3ed47a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:30.872612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-46050def-6d57-4a00-bd22-24e3ed47a33d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:30.873862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-46050def-6d57-4a00-bd22-24e3ed47a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:30.882065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 674/1360] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:30.931557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b098-ff02-4098-9edc-5505bef17d7f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:30.931891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b098-ff02-4098-9edc-5505bef17d7f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:30.932606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892b098-ff02-4098-9edc-5505bef17d7f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:30.934626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 687/1361] 10.222.0.23 () {54 vars in 959 bytes} [Tue Apr 26 14:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:30.940909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608a3b-9118-4fe6-b99e-21579a774856 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:30.941201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608a3b-9118-4fe6-b99e-21579a774856 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:30.941482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b608a3b-9118-4fe6-b99e-21579a774856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:30.989452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6b608a3b-9118-4fe6-b99e-21579a774856 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:30.990672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6b608a3b-9118-4fe6-b99e-21579a774856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:31.070932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 675/1362] 10.222.0.23 () {58 vars in 1056 bytes} [Tue Apr 26 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:31.079940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b098-ff02-4098-9edc-5505bef17d7f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:31.094928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892b098-ff02-4098-9edc-5505bef17d7f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:31.100613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a5509-0302-4627-915b-4457f4b630a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:31.101191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5509-0302-4627-915b-4457f4b630a0 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:31.101476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5509-0302-4627-915b-4457f4b630a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:31.101757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a5509-0302-4627-915b-4457f4b630a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:31.110119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a5509-0302-4627-915b-4457f4b630a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:31.111762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a5509-0302-4627-915b-4457f4b630a0 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:31.121607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 688/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:33.610504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f895b-2688-4fee-8b06-623c76833025 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:33.611050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f895b-2688-4fee-8b06-623c76833025 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:33.611050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f895b-2688-4fee-8b06-623c76833025 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:33.612809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 676/1364] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:33.617947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b720dc-ed44-4c36-a541-f2fbc09efce7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:33.618389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b720dc-ed44-4c36-a541-f2fbc09efce7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:33.618570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b720dc-ed44-4c36-a541-f2fbc09efce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:33.636621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e4b720dc-ed44-4c36-a541-f2fbc09efce7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:33.638653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e4b720dc-ed44-4c36-a541-f2fbc09efce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:33.650014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 689/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:33.691288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f895b-2688-4fee-8b06-623c76833025 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:33.707056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f895b-2688-4fee-8b06-623c76833025 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:33.713492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275939a1-f441-4057-aff0-689bfb7b535b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:33.716316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275939a1-f441-4057-aff0-689bfb7b535b service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:33.716316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275939a1-f441-4057-aff0-689bfb7b535b service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:33.716569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275939a1-f441-4057-aff0-689bfb7b535b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:33.726621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275939a1-f441-4057-aff0-689bfb7b535b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:33.728350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275939a1-f441-4057-aff0-689bfb7b535b service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:33.739301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 677/1366] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:02:36.431709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2463aa9-2307-49a4-8e26-a3b0bba7a4f7 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:36.432215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2463aa9-2307-49a4-8e26-a3b0bba7a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:36.432215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2463aa9-2307-49a4-8e26-a3b0bba7a4f7 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:36.434942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 690/1367] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:36.440488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e20d8-19c3-4f38-aa68-b396230d917b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:36.440488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e20d8-19c3-4f38-aa68-b396230d917b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:36.440488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e20d8-19c3-4f38-aa68-b396230d917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:36.457897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e92e20d8-19c3-4f38-aa68-b396230d917b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:36.459114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e92e20d8-19c3-4f38-aa68-b396230d917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:36.467142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 678/1368] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:36.512434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb466ca-27f0-4166-a3a7-fdd4ef12ed26 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:36.512728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb466ca-27f0-4166-a3a7-fdd4ef12ed26 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:36.520843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb466ca-27f0-4166-a3a7-fdd4ef12ed26 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:36.520843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 691/1369] 10.222.0.23 () {54 vars in 959 bytes} [Tue Apr 26 14:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:36.521030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fc82-96ba-4b41-b2c9-e6344e1b1370 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:36.521030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fc82-96ba-4b41-b2c9-e6344e1b1370 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:36.521030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7fc82-96ba-4b41-b2c9-e6344e1b1370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:36.541219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-43f7fc82-96ba-4b41-b2c9-e6344e1b1370 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:36.542441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-43f7fc82-96ba-4b41-b2c9-e6344e1b1370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:36.552110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 679/1370] 10.222.0.23 () {58 vars in 1056 bytes} [Tue Apr 26 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:02:36.560366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb466ca-27f0-4166-a3a7-fdd4ef12ed26 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:36.581576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb466ca-27f0-4166-a3a7-fdd4ef12ed26 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:36.587116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c4e00-94f8-4c58-9b1d-a8c56298683e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:36.587750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4e00-94f8-4c58-9b1d-a8c56298683e service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:36.588032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4e00-94f8-4c58-9b1d-a8c56298683e service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:36.588307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4e00-94f8-4c58-9b1d-a8c56298683e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:36.596287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c4e00-94f8-4c58-9b1d-a8c56298683e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:36.597846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c4e00-94f8-4c58-9b1d-a8c56298683e service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:36.607463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 692/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:39.122629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e957-d89b-4589-abbb-e816d5564bf1 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.123166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e957-d89b-4589-abbb-e816d5564bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.123166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3e957-d89b-4589-abbb-e816d5564bf1 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.124946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 680/1372] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:39.131095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ceab-54aa-4b3d-92a9-90ac9188222a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.131503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ceab-54aa-4b3d-92a9-90ac9188222a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.131673 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721ceab-54aa-4b3d-92a9-90ac9188222a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.150849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0721ceab-54aa-4b3d-92a9-90ac9188222a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:39.152070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0721ceab-54aa-4b3d-92a9-90ac9188222a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:39.160274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de012-3cbc-4d4f-9be5-868b6164fba5 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.160561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de012-3cbc-4d4f-9be5-868b6164fba5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.161038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517de012-3cbc-4d4f-9be5-868b6164fba5 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.161159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 693/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:39.163620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 681/1374] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 14:02:39.169605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8586b0-0137-4529-995e-17fdd3ed01b3 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.169896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8586b0-0137-4529-995e-17fdd3ed01b3 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.170213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8586b0-0137-4529-995e-17fdd3ed01b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.188487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1f8586b0-0137-4529-995e-17fdd3ed01b3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:39.189691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1f8586b0-0137-4529-995e-17fdd3ed01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:39.199174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 694/1375] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:39.207282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de012-3cbc-4d4f-9be5-868b6164fba5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:39.222187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517de012-3cbc-4d4f-9be5-868b6164fba5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:39.228209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542bed4-fe98-4e3f-8846-69ee49f7dcc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:39.228927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542bed4-fe98-4e3f-8846-69ee49f7dcc4 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.229283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542bed4-fe98-4e3f-8846-69ee49f7dcc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.229649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542bed4-fe98-4e3f-8846-69ee49f7dcc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.239111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542bed4-fe98-4e3f-8846-69ee49f7dcc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:39.240795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542bed4-fe98-4e3f-8846-69ee49f7dcc4 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:39.251480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 682/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:39.504645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1b90-2d7e-4dfa-b99d-318b6097e386 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.504645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1b90-2d7e-4dfa-b99d-318b6097e386 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.504645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1b90-2d7e-4dfa-b99d-318b6097e386 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.507270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 695/1377] 10.222.0.23 () {54 vars in 961 bytes} [Tue Apr 26 14:02:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:39.511319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9fd80-d921-4666-a091-1164dfcb830e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.512383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9fd80-d921-4666-a091-1164dfcb830e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.512761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9fd80-d921-4666-a091-1164dfcb830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.568134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3cd9fd80-d921-4666-a091-1164dfcb830e None None] MFA Rules not processed for user `57a82877b3b14091b942181b4887edff`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:39.569859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3cd9fd80-d921-4666-a091-1164dfcb830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:39.638665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 683/1378] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Apr 26 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:39.649520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1b90-2d7e-4dfa-b99d-318b6097e386 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:39.661070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1b90-2d7e-4dfa-b99d-318b6097e386 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:39.664975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4648473-4b29-4083-a912-61a2616151b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:39.665705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4648473-4b29-4083-a912-61a2616151b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:39.666103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4648473-4b29-4083-a912-61a2616151b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:39.666453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4648473-4b29-4083-a912-61a2616151b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:39.675911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4648473-4b29-4083-a912-61a2616151b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:39.677416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4648473-4b29-4083-a912-61a2616151b9 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:39.687066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 696/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:02:41.721131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891713ef-8e27-4dfe-91f0-48e3fd7cdb04 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:41.721793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891713ef-8e27-4dfe-91f0-48e3fd7cdb04 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:41.721793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891713ef-8e27-4dfe-91f0-48e3fd7cdb04 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:41.723461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 684/1380] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:41.728822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d9bad-7579-45fd-ac02-d9ebd40465de None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:41.729240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d9bad-7579-45fd-ac02-d9ebd40465de None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:41.729394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d9bad-7579-45fd-ac02-d9ebd40465de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:41.748310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ca1d9bad-7579-45fd-ac02-d9ebd40465de None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:41.749530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ca1d9bad-7579-45fd-ac02-d9ebd40465de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:41.757487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 697/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:02:41.802111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891713ef-8e27-4dfe-91f0-48e3fd7cdb04 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:41.820339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891713ef-8e27-4dfe-91f0-48e3fd7cdb04 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:41.826467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e5b62-1f9b-43d9-bff6-7df5824f7a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:41.827274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5b62-1f9b-43d9-bff6-7df5824f7a70 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:41.827556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5b62-1f9b-43d9-bff6-7df5824f7a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:41.827830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e5b62-1f9b-43d9-bff6-7df5824f7a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:41.837034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5b62-1f9b-43d9-bff6-7df5824f7a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:41.838708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e5b62-1f9b-43d9-bff6-7df5824f7a70 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:41.848461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 685/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:44.323528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b4cd-8320-497b-928e-53f28e13dc80 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:44.324714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b4cd-8320-497b-928e-53f28e13dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:44.324714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01b4cd-8320-497b-928e-53f28e13dc80 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:44.327027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 698/1383] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:44.331963 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f3c51-faec-4bca-b397-588a0647bd8b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:44.332396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f3c51-faec-4bca-b397-588a0647bd8b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:44.332523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f3c51-faec-4bca-b397-588a0647bd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:44.350868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b99f3c51-faec-4bca-b397-588a0647bd8b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:44.352049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b99f3c51-faec-4bca-b397-588a0647bd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:44.360331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 686/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:44.404916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01b4cd-8320-497b-928e-53f28e13dc80 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:44.424214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01b4cd-8320-497b-928e-53f28e13dc80 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:44.429986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f95d3-1cf9-4fab-a27e-a61c047ee0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:44.430647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f95d3-1cf9-4fab-a27e-a61c047ee0cc service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:44.430929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f95d3-1cf9-4fab-a27e-a61c047ee0cc service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:44.431230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f95d3-1cf9-4fab-a27e-a61c047ee0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:44.440239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f95d3-1cf9-4fab-a27e-a61c047ee0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:44.442196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f95d3-1cf9-4fab-a27e-a61c047ee0cc service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:44.463144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 699/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:46.921024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acc733-28e2-40df-8c85-0924c534b2e0 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:46.921600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acc733-28e2-40df-8c85-0924c534b2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:46.921600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acc733-28e2-40df-8c85-0924c534b2e0 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:46.923338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 687/1386] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:46.928772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4187c-8a9b-4401-9e19-75c89d6d8652 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:46.929213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4187c-8a9b-4401-9e19-75c89d6d8652 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:46.929415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4187c-8a9b-4401-9e19-75c89d6d8652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:46.948680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2ff4187c-8a9b-4401-9e19-75c89d6d8652 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:46.949886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2ff4187c-8a9b-4401-9e19-75c89d6d8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:46.958820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 700/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:47.001905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acc733-28e2-40df-8c85-0924c534b2e0 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:47.016715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acc733-28e2-40df-8c85-0924c534b2e0 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:47.022206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c95c-7b59-47fc-a5f9-98b0001412b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:47.023008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c95c-7b59-47fc-a5f9-98b0001412b1 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:47.023289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c95c-7b59-47fc-a5f9-98b0001412b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:47.023561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c95c-7b59-47fc-a5f9-98b0001412b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:47.032131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c95c-7b59-47fc-a5f9-98b0001412b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:47.033696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c95c-7b59-47fc-a5f9-98b0001412b1 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:47.044116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 688/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:49.790871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051aa9c-2bc4-4118-abb1-a2410c6b6351 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:49.791509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051aa9c-2bc4-4118-abb1-a2410c6b6351 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:49.791509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051aa9c-2bc4-4118-abb1-a2410c6b6351 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:49.793760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 701/1389] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:49.799064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461b70-c51f-449c-b5fe-b5b887784e70 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:49.799492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461b70-c51f-449c-b5fe-b5b887784e70 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:49.799707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9461b70-c51f-449c-b5fe-b5b887784e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:49.817577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e9461b70-c51f-449c-b5fe-b5b887784e70 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:49.818825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e9461b70-c51f-449c-b5fe-b5b887784e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:49.827250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 689/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:49.881538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051aa9c-2bc4-4118-abb1-a2410c6b6351 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:49.897307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051aa9c-2bc4-4118-abb1-a2410c6b6351 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:49.903708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95f1c-9011-4db0-957b-e99754894b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:49.904353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95f1c-9011-4db0-957b-e99754894b4d service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:49.904641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95f1c-9011-4db0-957b-e99754894b4d service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:49.904924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95f1c-9011-4db0-957b-e99754894b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:49.913809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95f1c-9011-4db0-957b-e99754894b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:49.915541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95f1c-9011-4db0-957b-e99754894b4d service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:49.925816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 702/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:52.393351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b074b26-45a1-48c3-9fd3-f24859060271 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:52.393881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b074b26-45a1-48c3-9fd3-f24859060271 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:52.393881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b074b26-45a1-48c3-9fd3-f24859060271 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:52.395788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 690/1392] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:52.402552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7c73-2fae-4c38-8dc8-423509ee8ff7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:52.403005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7c73-2fae-4c38-8dc8-423509ee8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:52.403114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7c73-2fae-4c38-8dc8-423509ee8ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:52.423040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-686a7c73-2fae-4c38-8dc8-423509ee8ff7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:52.424261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-686a7c73-2fae-4c38-8dc8-423509ee8ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:52.432600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 703/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:52.479142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b074b26-45a1-48c3-9fd3-f24859060271 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:52.494340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b074b26-45a1-48c3-9fd3-f24859060271 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:52.499900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb713ed7-7e99-4945-893d-ac4cd825e0e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:52.500532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713ed7-7e99-4945-893d-ac4cd825e0e7 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:52.500812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713ed7-7e99-4945-893d-ac4cd825e0e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:52.501092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb713ed7-7e99-4945-893d-ac4cd825e0e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:52.509385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb713ed7-7e99-4945-893d-ac4cd825e0e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:52.511141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb713ed7-7e99-4945-893d-ac4cd825e0e7 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:52.520484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 691/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:54.972244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f47108-5332-44a1-bd54-59ad074802c2 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:54.972858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f47108-5332-44a1-bd54-59ad074802c2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:54.972858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f47108-5332-44a1-bd54-59ad074802c2 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:54.974627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 704/1395] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:54.979803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678e2d-b1cc-4c96-ba3e-b5915097d893 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:54.980231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678e2d-b1cc-4c96-ba3e-b5915097d893 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:54.980424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb678e2d-b1cc-4c96-ba3e-b5915097d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:54.998644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-bb678e2d-b1cc-4c96-ba3e-b5915097d893 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:55.002266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bb678e2d-b1cc-4c96-ba3e-b5915097d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:55.007632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 692/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:55.052212 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f47108-5332-44a1-bd54-59ad074802c2 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:55.067022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f47108-5332-44a1-bd54-59ad074802c2 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:55.072579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4621-d473-4b91-a737-dc94e41bc295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:55.073213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4621-d473-4b91-a737-dc94e41bc295 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:55.073498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4621-d473-4b91-a737-dc94e41bc295 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:55.074371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4621-d473-4b91-a737-dc94e41bc295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:55.082503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4621-d473-4b91-a737-dc94e41bc295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:55.084132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4621-d473-4b91-a737-dc94e41bc295 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:55.093367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 705/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:56.215634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02fe4-2ea4-4444-8075-c452d08ceafd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:56.216253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02fe4-2ea4-4444-8075-c452d08ceafd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:56.216253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02fe4-2ea4-4444-8075-c452d08ceafd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:56.217950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 693/1398] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:56.223262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f20ac-c9cf-44ae-a4a9-1d805b44c3dc None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:56.223676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f20ac-c9cf-44ae-a4a9-1d805b44c3dc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:56.223854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f20ac-c9cf-44ae-a4a9-1d805b44c3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:56.246546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d39f20ac-c9cf-44ae-a4a9-1d805b44c3dc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:56.248073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d39f20ac-c9cf-44ae-a4a9-1d805b44c3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:56.259699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 706/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:56.318936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0591-fab9-4284-9c84-3374e6434311 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:56.319227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0591-fab9-4284-9c84-3374e6434311 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:56.319511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0591-fab9-4284-9c84-3374e6434311 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:56.321272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 694/1400] 10.222.0.23 () {54 vars in 961 bytes} [Tue Apr 26 14:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:56.327085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df710f-60e8-42c4-bba1-ef166a6aa1b8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:56.327376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df710f-60e8-42c4-bba1-ef166a6aa1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:56.327655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df710f-60e8-42c4-bba1-ef166a6aa1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:56.377859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-08df710f-60e8-42c4-bba1-ef166a6aa1b8 None None] MFA Rules not processed for user `2132fa7fbd034deb938e9032ec710d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:56.379105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-08df710f-60e8-42c4-bba1-ef166a6aa1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:56.439036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 707/1401] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Apr 26 14:02:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:56.447242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0591-fab9-4284-9c84-3374e6434311 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:56.458658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0591-fab9-4284-9c84-3374e6434311 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:56.462283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20504a2e-14a7-4539-bee1-a5ceeb6333a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:56.462924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504a2e-14a7-4539-bee1-a5ceeb6333a3 service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:56.463211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504a2e-14a7-4539-bee1-a5ceeb6333a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:56.463493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20504a2e-14a7-4539-bee1-a5ceeb6333a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:56.472634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20504a2e-14a7-4539-bee1-a5ceeb6333a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:56.474034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20504a2e-14a7-4539-bee1-a5ceeb6333a3 service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:56.483244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 695/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:02:57.073821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7897a-ea27-4fd1-bd52-68ec7187c333 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.074189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7897a-ea27-4fd1-bd52-68ec7187c333 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.074471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7897a-ea27-4fd1-bd52-68ec7187c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.125452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-48e7897a-ea27-4fd1-bd52-68ec7187c333 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:57.126671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-48e7897a-ea27-4fd1-bd52-68ec7187c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:57.190910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 708/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:02:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:57.232162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578db62-d146-4d3c-8bc2-a67d752637bb None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.232675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578db62-d146-4d3c-8bc2-a67d752637bb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.232765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578db62-d146-4d3c-8bc2-a67d752637bb None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.234593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 696/1404] 10.222.0.23 () {54 vars in 942 bytes} [Tue Apr 26 14:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:57.241141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e231aa-ea87-4224-97cd-965e56c72838 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.241565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e231aa-ea87-4224-97cd-965e56c72838 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.241679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e231aa-ea87-4224-97cd-965e56c72838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.291699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-98e231aa-ea87-4224-97cd-965e56c72838 None None] MFA Rules not processed for user `e24a392a4a96416bb50306d6443036ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:57.293513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-98e231aa-ea87-4224-97cd-965e56c72838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:57.362261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 709/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Tue Apr 26 14:02:57 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:57.371520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578db62-d146-4d3c-8bc2-a67d752637bb None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:57.384528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578db62-d146-4d3c-8bc2-a67d752637bb None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:57.389992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2c5a8-edd8-4914-88cb-b244985c66cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:57.390638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2c5a8-edd8-4914-88cb-b244985c66cd service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.390923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2c5a8-edd8-4914-88cb-b244985c66cd service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.391202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2c5a8-edd8-4914-88cb-b244985c66cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.399242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2c5a8-edd8-4914-88cb-b244985c66cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:57.400829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2c5a8-edd8-4914-88cb-b244985c66cd service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:57.409279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 697/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:02:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:02:57.547052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a360-9e0a-4a1e-9665-0d76af79b167 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.547345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a360-9e0a-4a1e-9665-0d76af79b167 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.547626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778a360-9e0a-4a1e-9665-0d76af79b167 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.549551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 710/1407] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:02:57.554933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeef34-978e-4489-9cf3-f7e31e83c047 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.555229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeef34-978e-4489-9cf3-f7e31e83c047 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.555508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eeef34-978e-4489-9cf3-f7e31e83c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.573113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c8eeef34-978e-4489-9cf3-f7e31e83c047 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:02:57.574844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c8eeef34-978e-4489-9cf3-f7e31e83c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:02:57.582642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 698/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:02:57.625873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a360-9e0a-4a1e-9665-0d76af79b167 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:02:57.640555 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778a360-9e0a-4a1e-9665-0d76af79b167 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:02:57.645977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95ba60-a7bf-499a-9b04-25a0cfcd29a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:02:57.646617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ba60-a7bf-499a-9b04-25a0cfcd29a1 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:02:57.646899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ba60-a7bf-499a-9b04-25a0cfcd29a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:02:57.647176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95ba60-a7bf-499a-9b04-25a0cfcd29a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:02:57.656225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95ba60-a7bf-499a-9b04-25a0cfcd29a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:02:57.657823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95ba60-a7bf-499a-9b04-25a0cfcd29a1 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:02:57.668137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 711/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:03:00.168374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439858d0-1d9c-4f78-97d3-23c11ffd1b92 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:00.168942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439858d0-1d9c-4f78-97d3-23c11ffd1b92 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:00.168942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439858d0-1d9c-4f78-97d3-23c11ffd1b92 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:00.170754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 699/1410] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:00.176126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6397ea-d3da-4269-b341-4f0c52cfbf96 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:00.176575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6397ea-d3da-4269-b341-4f0c52cfbf96 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:00.176871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6397ea-d3da-4269-b341-4f0c52cfbf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:00.198715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-cb6397ea-d3da-4269-b341-4f0c52cfbf96 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:00.200089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cb6397ea-d3da-4269-b341-4f0c52cfbf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:00.208483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 712/1411] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:00.255325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439858d0-1d9c-4f78-97d3-23c11ffd1b92 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:00.272987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439858d0-1d9c-4f78-97d3-23c11ffd1b92 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:00.279505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bea86b-fc86-4aa8-8fe1-7db95670ded7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:00.280787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bea86b-fc86-4aa8-8fe1-7db95670ded7 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:00.280787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bea86b-fc86-4aa8-8fe1-7db95670ded7 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:00.280787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bea86b-fc86-4aa8-8fe1-7db95670ded7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:00.290256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bea86b-fc86-4aa8-8fe1-7db95670ded7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:00.291859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bea86b-fc86-4aa8-8fe1-7db95670ded7 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:00.302723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 700/1412] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:21.785944 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933cdd-26e0-4c26-b906-cd4b91a63005 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:21.786608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933cdd-26e0-4c26-b906-cd4b91a63005 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:21.786608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38933cdd-26e0-4c26-b906-cd4b91a63005 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:21.788651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 713/1413] 10.222.0.23 () {54 vars in 918 bytes} [Tue Apr 26 14:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:21.794788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a85bac-6ba9-43c9-991b-1ef83ad0a243 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:21.795269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a85bac-6ba9-43c9-991b-1ef83ad0a243 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:21.795357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a85bac-6ba9-43c9-991b-1ef83ad0a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:21.813854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-34a85bac-6ba9-43c9-991b-1ef83ad0a243 None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:21.815069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-34a85bac-6ba9-43c9-991b-1ef83ad0a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:21.824255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 701/1414] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Apr 26 14:03:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:03:21.842070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643499e3-c4dd-4650-8890-9042a639f6fc None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:21.842070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643499e3-c4dd-4650-8890-9042a639f6fc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:21.842070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643499e3-c4dd-4650-8890-9042a639f6fc None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:21.842070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 714/1415] 10.222.0.23 () {54 vars in 918 bytes} [Tue Apr 26 14:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:21.847204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f03c1-ce87-40c4-9dbf-7295e451f7b1 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:21.847494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f03c1-ce87-40c4-9dbf-7295e451f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:21.847770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f03c1-ce87-40c4-9dbf-7295e451f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:21.866999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-647f03c1-ce87-40c4-9dbf-7295e451f7b1 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:21.868191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-647f03c1-ce87-40c4-9dbf-7295e451f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:21.877274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 702/1416] 10.222.0.23 () {58 vars in 1015 bytes} [Tue Apr 26 14:03:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:03:24.632889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b403-a55a-4cb9-94b7-a6fd35f5901a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:24.633470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b403-a55a-4cb9-94b7-a6fd35f5901a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:24.633470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943b403-a55a-4cb9-94b7-a6fd35f5901a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:24.635833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:24.641207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaaf1-2c8f-4d78-820e-36bd5493f461 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:24.641633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaaf1-2c8f-4d78-820e-36bd5493f461 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:24.641776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaaf1-2c8f-4d78-820e-36bd5493f461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:24.660940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a2beaaf1-2c8f-4d78-820e-36bd5493f461 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:24.662181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a2beaaf1-2c8f-4d78-820e-36bd5493f461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:24.670255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:24.712009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b403-a55a-4cb9-94b7-a6fd35f5901a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:24.727020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943b403-a55a-4cb9-94b7-a6fd35f5901a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:24.732315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf531895-fd2d-4d53-83bb-5d966a60ea5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:24.732936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf531895-fd2d-4d53-83bb-5d966a60ea5b service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:24.733216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf531895-fd2d-4d53-83bb-5d966a60ea5b service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:24.733492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf531895-fd2d-4d53-83bb-5d966a60ea5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:24.741221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf531895-fd2d-4d53-83bb-5d966a60ea5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:24.742850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf531895-fd2d-4d53-83bb-5d966a60ea5b service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:24.753136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 716/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:26.161220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173b899-28ea-430c-ac43-4aa92defe639 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:26.161805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173b899-28ea-430c-ac43-4aa92defe639 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:26.161805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173b899-28ea-430c-ac43-4aa92defe639 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:26.163806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:26.169142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d5f0a-6395-4a6c-b3bf-90aba8b26dce None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:26.169567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d5f0a-6395-4a6c-b3bf-90aba8b26dce None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:26.169699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d5f0a-6395-4a6c-b3bf-90aba8b26dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:26.188918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-907d5f0a-6395-4a6c-b3bf-90aba8b26dce None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:26.190195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-907d5f0a-6395-4a6c-b3bf-90aba8b26dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:26.198172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:03:26.361346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173b899-28ea-430c-ac43-4aa92defe639 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:26.376928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173b899-28ea-430c-ac43-4aa92defe639 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:26.382879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd1b9-effd-4d74-9566-489ff040d323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:26.383608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd1b9-effd-4d74-9566-489ff040d323 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:26.383927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd1b9-effd-4d74-9566-489ff040d323 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:26.384239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd1b9-effd-4d74-9566-489ff040d323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:26.393279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd1b9-effd-4d74-9566-489ff040d323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:26.395069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd1b9-effd-4d74-9566-489ff040d323 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:26.405184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 705/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:27.712990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54c2b-d7f6-44d3-a981-c73b253e433c None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:27.713517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54c2b-d7f6-44d3-a981-c73b253e433c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:27.713517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54c2b-d7f6-44d3-a981-c73b253e433c None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:27.715802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:27.720718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0c5ed-74f0-40ea-8183-c1f9afde0689 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:27.721142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0c5ed-74f0-40ea-8183-c1f9afde0689 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:27.721254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0c5ed-74f0-40ea-8183-c1f9afde0689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:27.739846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c1b0c5ed-74f0-40ea-8183-c1f9afde0689 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:27.741044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c1b0c5ed-74f0-40ea-8183-c1f9afde0689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:27.749046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:27.901253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e54c2b-d7f6-44d3-a981-c73b253e433c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:27.916844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e54c2b-d7f6-44d3-a981-c73b253e433c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:27.922701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744b138-8f99-436a-8d9f-c93d858c3dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:27.923331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744b138-8f99-436a-8d9f-c93d858c3dff service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:27.923617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744b138-8f99-436a-8d9f-c93d858c3dff service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:27.923896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744b138-8f99-436a-8d9f-c93d858c3dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:27.931792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744b138-8f99-436a-8d9f-c93d858c3dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:27.933360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744b138-8f99-436a-8d9f-c93d858c3dff service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:27.942520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 719/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:29.275822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a8ae-7a80-4fde-b3a6-bcff9abf21bd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:29.276353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a8ae-7a80-4fde-b3a6-bcff9abf21bd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:29.276986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a8ae-7a80-4fde-b3a6-bcff9abf21bd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:29.278959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:29.284010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f863b-f203-426e-a4d7-48430a2750dd None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:29.284448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f863b-f203-426e-a4d7-48430a2750dd None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:29.284562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f863b-f203-426e-a4d7-48430a2750dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:29.303660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8c5f863b-f203-426e-a4d7-48430a2750dd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:29.304852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8c5f863b-f203-426e-a4d7-48430a2750dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:29.312569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:29.462085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307a8ae-7a80-4fde-b3a6-bcff9abf21bd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:29.476695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307a8ae-7a80-4fde-b3a6-bcff9abf21bd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:29.482829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657cf8b-fd00-4ecf-91d7-fef8a3bbb838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:29.483466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657cf8b-fd00-4ecf-91d7-fef8a3bbb838 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:29.483750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657cf8b-fd00-4ecf-91d7-fef8a3bbb838 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:29.484028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657cf8b-fd00-4ecf-91d7-fef8a3bbb838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:29.491968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657cf8b-fd00-4ecf-91d7-fef8a3bbb838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:29.493540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657cf8b-fd00-4ecf-91d7-fef8a3bbb838 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:29.502772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 708/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:30.876824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377fc0c-3b67-47b4-b314-bbcc4e98c493 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:30.877541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377fc0c-3b67-47b4-b314-bbcc4e98c493 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:30.877541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377fc0c-3b67-47b4-b314-bbcc4e98c493 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:30.879211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:30.884898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105e70-a79e-4182-927c-fe0e30ffa340 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:30.885348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105e70-a79e-4182-927c-fe0e30ffa340 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:30.885466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd105e70-a79e-4182-927c-fe0e30ffa340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:30.903739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dd105e70-a79e-4182-927c-fe0e30ffa340 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:30.904937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dd105e70-a79e-4182-927c-fe0e30ffa340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:30.912766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:03:31.073192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377fc0c-3b67-47b4-b314-bbcc4e98c493 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:31.088269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377fc0c-3b67-47b4-b314-bbcc4e98c493 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:31.094552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748324c-2766-4ce1-b9e9-4f65c10223b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:31.095186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748324c-2766-4ce1-b9e9-4f65c10223b3 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:31.095472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748324c-2766-4ce1-b9e9-4f65c10223b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:31.095753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748324c-2766-4ce1-b9e9-4f65c10223b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:31.103961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748324c-2766-4ce1-b9e9-4f65c10223b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:31.105625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748324c-2766-4ce1-b9e9-4f65c10223b3 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:31.114747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 722/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:32.467632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bde3-8ed0-4211-97ec-ffac7b194e40 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:32.468167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bde3-8ed0-4211-97ec-ffac7b194e40 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:32.468283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7bde3-8ed0-4211-97ec-ffac7b194e40 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:32.470158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:32.475333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edf84-d3ea-4d5e-b537-4d51a10079e5 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:32.475739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edf84-d3ea-4d5e-b537-4d51a10079e5 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:32.475900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46edf84-d3ea-4d5e-b537-4d51a10079e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:32.495385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e46edf84-d3ea-4d5e-b537-4d51a10079e5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:32.496598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e46edf84-d3ea-4d5e-b537-4d51a10079e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:32.504517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:32.656937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bde3-8ed0-4211-97ec-ffac7b194e40 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:32.671140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7bde3-8ed0-4211-97ec-ffac7b194e40 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:32.676419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2773b-efc9-49a6-a88a-66f462d9a07f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:32.677040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2773b-efc9-49a6-a88a-66f462d9a07f service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:32.677321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2773b-efc9-49a6-a88a-66f462d9a07f service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:32.677771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2773b-efc9-49a6-a88a-66f462d9a07f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:32.685519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2773b-efc9-49a6-a88a-66f462d9a07f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:32.687132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2773b-efc9-49a6-a88a-66f462d9a07f service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:32.696670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 711/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:33.988596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29991f1a-c12b-4894-b624-6c76c00719cb None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:33.989189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29991f1a-c12b-4894-b624-6c76c00719cb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:33.989189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29991f1a-c12b-4894-b624-6c76c00719cb None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:33.990998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:33.996376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33907f7-00d1-4460-acbd-8f63ae5d3a23 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:33.996820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33907f7-00d1-4460-acbd-8f63ae5d3a23 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:33.996927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33907f7-00d1-4460-acbd-8f63ae5d3a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:34.014973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c33907f7-00d1-4460-acbd-8f63ae5d3a23 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:34.016156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c33907f7-00d1-4460-acbd-8f63ae5d3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:34.023803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:03:34.185645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29991f1a-c12b-4894-b624-6c76c00719cb None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:34.199980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29991f1a-c12b-4894-b624-6c76c00719cb None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:34.205291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552096d-132a-4333-8e13-2e253599642a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:34.205925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552096d-132a-4333-8e13-2e253599642a service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:34.206248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552096d-132a-4333-8e13-2e253599642a service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:34.206528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552096d-132a-4333-8e13-2e253599642a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:34.214448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552096d-132a-4333-8e13-2e253599642a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:34.216021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552096d-132a-4333-8e13-2e253599642a service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:34.225218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 725/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:35.504725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0de75-d066-4e76-be50-1e30a4b3d05c None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:35.505322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0de75-d066-4e76-be50-1e30a4b3d05c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:35.505430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0de75-d066-4e76-be50-1e30a4b3d05c None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:35.507637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:35.512624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafc85b-df37-4c47-a3ae-fec4a722eb5e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:35.513081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafc85b-df37-4c47-a3ae-fec4a722eb5e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:35.513202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafc85b-df37-4c47-a3ae-fec4a722eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:35.531661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2cafc85b-df37-4c47-a3ae-fec4a722eb5e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:35.532852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2cafc85b-df37-4c47-a3ae-fec4a722eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:35.540832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:35.695761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0de75-d066-4e76-be50-1e30a4b3d05c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:35.709670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0de75-d066-4e76-be50-1e30a4b3d05c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:35.715011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d303fcb-2166-4c20-a679-0dc827eb17ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:35.715638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303fcb-2166-4c20-a679-0dc827eb17ed service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:35.715921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303fcb-2166-4c20-a679-0dc827eb17ed service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:35.716200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d303fcb-2166-4c20-a679-0dc827eb17ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:35.724088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d303fcb-2166-4c20-a679-0dc827eb17ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:35.725661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d303fcb-2166-4c20-a679-0dc827eb17ed service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:35.735383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 714/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:37.034825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dca437-a183-412f-9165-98c731d911cc None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:37.035404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dca437-a183-412f-9165-98c731d911cc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:37.035404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dca437-a183-412f-9165-98c731d911cc None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:37.037183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:37.042503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b58a2-ece1-48da-bddc-9da2a46f30e2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:37.043493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b58a2-ece1-48da-bddc-9da2a46f30e2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:37.043677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b58a2-ece1-48da-bddc-9da2a46f30e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:37.061256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4c6b58a2-ece1-48da-bddc-9da2a46f30e2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:37.062563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4c6b58a2-ece1-48da-bddc-9da2a46f30e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:37.070286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:37.218437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dca437-a183-412f-9165-98c731d911cc None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:37.232933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dca437-a183-412f-9165-98c731d911cc None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:37.238242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd27292-7b42-4040-abba-6f2aa0479ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:37.238866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd27292-7b42-4040-abba-6f2aa0479ca9 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:37.239146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd27292-7b42-4040-abba-6f2aa0479ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:37.239420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd27292-7b42-4040-abba-6f2aa0479ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:37.247906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd27292-7b42-4040-abba-6f2aa0479ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:37.249467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd27292-7b42-4040-abba-6f2aa0479ca9 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:37.258527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 728/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:39.408427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38aac-0f67-4efb-abe1-9e6727cc1230 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:39.408977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38aac-0f67-4efb-abe1-9e6727cc1230 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:39.408977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da38aac-0f67-4efb-abe1-9e6727cc1230 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:39.410800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:39.416253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f49c4-2daa-4ebb-87a1-26d44a6b276c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:39.416706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f49c4-2daa-4ebb-87a1-26d44a6b276c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:39.416822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f49c4-2daa-4ebb-87a1-26d44a6b276c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:39.435331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b27f49c4-2daa-4ebb-87a1-26d44a6b276c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:39.436524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b27f49c4-2daa-4ebb-87a1-26d44a6b276c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:39.444773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:39.483679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38aac-0f67-4efb-abe1-9e6727cc1230 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:39.494127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da38aac-0f67-4efb-abe1-9e6727cc1230 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:39.497602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524f44-f420-4d48-83cc-0eb4020b501d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:39.498259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f44-f420-4d48-83cc-0eb4020b501d service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:39.498546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f44-f420-4d48-83cc-0eb4020b501d service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:39.498889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524f44-f420-4d48-83cc-0eb4020b501d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:39.507789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524f44-f420-4d48-83cc-0eb4020b501d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:39.509308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524f44-f420-4d48-83cc-0eb4020b501d service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:39.519036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 717/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:41.899724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4872a2-4d07-4074-8f96-2924831743ba None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:41.900359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4872a2-4d07-4074-8f96-2924831743ba None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:41.900359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4872a2-4d07-4074-8f96-2924831743ba None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:41.902693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:41.907881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad59b-5e56-4047-8535-c1ba529dd025 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:41.908329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad59b-5e56-4047-8535-c1ba529dd025 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:41.908489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ad59b-5e56-4047-8535-c1ba529dd025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:41.926133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e32ad59b-5e56-4047-8535-c1ba529dd025 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:41.927322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e32ad59b-5e56-4047-8535-c1ba529dd025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:41.935565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:41.972703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4872a2-4d07-4074-8f96-2924831743ba None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:41.983326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4872a2-4d07-4074-8f96-2924831743ba None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:41.986798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690330e-0637-42a5-923e-24de9d31945c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:41.987530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690330e-0637-42a5-923e-24de9d31945c service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:41.987813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690330e-0637-42a5-923e-24de9d31945c service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:41.988091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690330e-0637-42a5-923e-24de9d31945c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:41.997313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690330e-0637-42a5-923e-24de9d31945c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:41.998765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690330e-0637-42a5-923e-24de9d31945c service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:42.007904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 731/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:44.615552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d556-5fe7-4849-9117-b9b7b89f5eec None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:44.616084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d556-5fe7-4849-9117-b9b7b89f5eec None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:44.616084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d556-5fe7-4849-9117-b9b7b89f5eec None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:44.617870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:44.623682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872917-7856-436a-864e-4f6b487da015 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:44.624107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872917-7856-436a-864e-4f6b487da015 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:44.624218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1872917-7856-436a-864e-4f6b487da015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:44.641443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b1872917-7856-436a-864e-4f6b487da015 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:44.642667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b1872917-7856-436a-864e-4f6b487da015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:44.650227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:44.688427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d556-5fe7-4849-9117-b9b7b89f5eec None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:44.699586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d556-5fe7-4849-9117-b9b7b89f5eec None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:44.703024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da00ce-12a0-4053-8fab-58b15ea33167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:44.703648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da00ce-12a0-4053-8fab-58b15ea33167 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:44.703928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da00ce-12a0-4053-8fab-58b15ea33167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:44.704202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da00ce-12a0-4053-8fab-58b15ea33167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:44.712728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da00ce-12a0-4053-8fab-58b15ea33167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:44.714208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da00ce-12a0-4053-8fab-58b15ea33167 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:44.723932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 720/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:47.117558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdb52-5520-4745-b3a9-5f894d43e2ee None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:47.118237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdb52-5520-4745-b3a9-5f894d43e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:47.118237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcdb52-5520-4745-b3a9-5f894d43e2ee None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:47.119943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:47.125229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db307-0e83-4245-bc1e-0884230204e8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:47.125640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db307-0e83-4245-bc1e-0884230204e8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:47.125789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db307-0e83-4245-bc1e-0884230204e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:47.143980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4b7db307-0e83-4245-bc1e-0884230204e8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:47.145197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4b7db307-0e83-4245-bc1e-0884230204e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:47.153828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:47.192941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcdb52-5520-4745-b3a9-5f894d43e2ee None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:47.204212 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcdb52-5520-4745-b3a9-5f894d43e2ee None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:47.207667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d5519-7882-4e08-884f-bc71da01fab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:47.208285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5519-7882-4e08-884f-bc71da01fab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:47.208564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5519-7882-4e08-884f-bc71da01fab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:47.208834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d5519-7882-4e08-884f-bc71da01fab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:47.217407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5519-7882-4e08-884f-bc71da01fab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:47.218858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d5519-7882-4e08-884f-bc71da01fab9 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:47.227810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 734/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:49.546400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779fb13-e41c-459c-b087-22647e4439ad None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:49.546965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779fb13-e41c-459c-b087-22647e4439ad None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:49.546965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779fb13-e41c-459c-b087-22647e4439ad None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:49.548772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:49.554106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d5b3-ff6c-471c-a398-5654059efa74 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:49.554554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d5b3-ff6c-471c-a398-5654059efa74 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:49.554667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85d5b3-ff6c-471c-a398-5654059efa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:49.572645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-eb85d5b3-ff6c-471c-a398-5654059efa74 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:49.574495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-eb85d5b3-ff6c-471c-a398-5654059efa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:49.582307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:49.619697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779fb13-e41c-459c-b087-22647e4439ad None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:49.630648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779fb13-e41c-459c-b087-22647e4439ad None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:49.635039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebd3a5-9c55-454c-a774-5fdb50d0c6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:49.636173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebd3a5-9c55-454c-a774-5fdb50d0c6ab service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:49.636455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebd3a5-9c55-454c-a774-5fdb50d0c6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:49.636727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebd3a5-9c55-454c-a774-5fdb50d0c6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:49.647210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebd3a5-9c55-454c-a774-5fdb50d0c6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:49.648627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebd3a5-9c55-454c-a774-5fdb50d0c6ab service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:49.657658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 723/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:03:51.973491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d7a1-d3da-4c6c-b5d0-113e269a5e3a None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:51.974091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d7a1-d3da-4c6c-b5d0-113e269a5e3a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:51.974091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d7a1-d3da-4c6c-b5d0-113e269a5e3a None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:51.975865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:51.981219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ab87-5e0f-4e4c-83b3-d8bdc75b190e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:51.981651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ab87-5e0f-4e4c-83b3-d8bdc75b190e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:51.981780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254ab87-5e0f-4e4c-83b3-d8bdc75b190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:51.999998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9254ab87-5e0f-4e4c-83b3-d8bdc75b190e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:52.001187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9254ab87-5e0f-4e4c-83b3-d8bdc75b190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:52.008894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:52.047524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d7a1-d3da-4c6c-b5d0-113e269a5e3a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:52.058663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d7a1-d3da-4c6c-b5d0-113e269a5e3a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:52.062240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caee13-a010-48d9-acc6-e07f43a7be76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:52.062890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caee13-a010-48d9-acc6-e07f43a7be76 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:52.063176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caee13-a010-48d9-acc6-e07f43a7be76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:52.063454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caee13-a010-48d9-acc6-e07f43a7be76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:52.072216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caee13-a010-48d9-acc6-e07f43a7be76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:52.073680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caee13-a010-48d9-acc6-e07f43a7be76 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:52.082792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 737/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:54.386670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e84fc-c034-46f2-96f9-957549ac8bcd None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:54.387232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e84fc-c034-46f2-96f9-957549ac8bcd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:54.387232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e84fc-c034-46f2-96f9-957549ac8bcd None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:54.389018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:54.394166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8319e3b-2ec1-4558-8fec-93cce1023279 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:54.394572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8319e3b-2ec1-4558-8fec-93cce1023279 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:54.394735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8319e3b-2ec1-4558-8fec-93cce1023279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:54.412726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e8319e3b-2ec1-4558-8fec-93cce1023279 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:54.414198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e8319e3b-2ec1-4558-8fec-93cce1023279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:54.421808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:54.458733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e84fc-c034-46f2-96f9-957549ac8bcd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:54.471333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e84fc-c034-46f2-96f9-957549ac8bcd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:54.475759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226b5db-d8c3-423b-a8a5-ac05e3edf7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:54.476397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226b5db-d8c3-423b-a8a5-ac05e3edf7fa service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:54.476678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226b5db-d8c3-423b-a8a5-ac05e3edf7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:54.476953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226b5db-d8c3-423b-a8a5-ac05e3edf7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:54.486107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226b5db-d8c3-423b-a8a5-ac05e3edf7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:54.487630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226b5db-d8c3-423b-a8a5-ac05e3edf7fa service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:54.497603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 726/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:56.801892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058a00-01f5-4d94-b643-6ef2f3e1af9b None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:56.802484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058a00-01f5-4d94-b643-6ef2f3e1af9b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:56.802484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57058a00-01f5-4d94-b643-6ef2f3e1af9b None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:56.804280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:56.810096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b706-32d2-45c5-a160-0d346e37ad3b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:56.810528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b706-32d2-45c5-a160-0d346e37ad3b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:56.810668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38b706-32d2-45c5-a160-0d346e37ad3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:56.827949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3d38b706-32d2-45c5-a160-0d346e37ad3b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:56.829145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3d38b706-32d2-45c5-a160-0d346e37ad3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:56.836895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:56.874552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058a00-01f5-4d94-b643-6ef2f3e1af9b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:56.885159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57058a00-01f5-4d94-b643-6ef2f3e1af9b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:56.888689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139552-7b8e-4a18-a60a-3d33156d3ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:56.889315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139552-7b8e-4a18-a60a-3d33156d3ece service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:56.889599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139552-7b8e-4a18-a60a-3d33156d3ece service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:56.889877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139552-7b8e-4a18-a60a-3d33156d3ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:56.898488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6139552-7b8e-4a18-a60a-3d33156d3ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:56.899911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6139552-7b8e-4a18-a60a-3d33156d3ece service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:56.909793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 740/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:59.228404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8d55-f5b1-4e60-a6a1-dba627a7f024 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:59.228919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8d55-f5b1-4e60-a6a1-dba627a7f024 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:59.229040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a8d55-f5b1-4e60-a6a1-dba627a7f024 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:59.230957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:03:59.236126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1b67-d362-4c7e-9581-24635bfcc251 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:59.236545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1b67-d362-4c7e-9581-24635bfcc251 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:59.236665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed1b67-d362-4c7e-9581-24635bfcc251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:59.254913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-4fed1b67-d362-4c7e-9581-24635bfcc251 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:03:59.256123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4fed1b67-d362-4c7e-9581-24635bfcc251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:03:59.264569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:03:59.300190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a8d55-f5b1-4e60-a6a1-dba627a7f024 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:03:59.311429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a8d55-f5b1-4e60-a6a1-dba627a7f024 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:03:59.315063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c17ff8-05b8-4135-b4b4-0d5d59a6e04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:03:59.315693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c17ff8-05b8-4135-b4b4-0d5d59a6e04f service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:03:59.315987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c17ff8-05b8-4135-b4b4-0d5d59a6e04f service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:03:59.316250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c17ff8-05b8-4135-b4b4-0d5d59a6e04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:03:59.325507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c17ff8-05b8-4135-b4b4-0d5d59a6e04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:03:59.326965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c17ff8-05b8-4135-b4b4-0d5d59a6e04f service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:03:59.336124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 729/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:04:01.634692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aabd7-7c91-4012-8e2a-e7a227f40f3f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:01.635264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aabd7-7c91-4012-8e2a-e7a227f40f3f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:01.635264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1aabd7-7c91-4012-8e2a-e7a227f40f3f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:01.638103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 742/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:01.643382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0783-ab2f-4f32-bc19-fb45de2d6354 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:01.643814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0783-ab2f-4f32-bc19-fb45de2d6354 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:01.643949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b0783-ab2f-4f32-bc19-fb45de2d6354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:01.661407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-458b0783-ab2f-4f32-bc19-fb45de2d6354 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:01.662618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-458b0783-ab2f-4f32-bc19-fb45de2d6354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:01.670608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 730/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:01.708201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aabd7-7c91-4012-8e2a-e7a227f40f3f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:01.709857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7e1aabd7-7c91-4012-8e2a-e7a227f40f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:01.722706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1aabd7-7c91-4012-8e2a-e7a227f40f3f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:01.726165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f123-bd57-478a-8dcf-344fc98882c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:01.726787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f123-bd57-478a-8dcf-344fc98882c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:01.727067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f123-bd57-478a-8dcf-344fc98882c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:01.727338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f123-bd57-478a-8dcf-344fc98882c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:01.736391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3f123-bd57-478a-8dcf-344fc98882c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:01.737815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3f123-bd57-478a-8dcf-344fc98882c3 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:01.747730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 743/1473] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:04:18.387702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e1ebd-059c-46cd-a712-399cb2a6fa20 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:18.388313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e1ebd-059c-46cd-a712-399cb2a6fa20 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:18.388313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e1ebd-059c-46cd-a712-399cb2a6fa20 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:18.390135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 731/1474] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 14:04:18.395446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f07d6-5389-4df6-85b2-fe0afb4b4ca7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:18.395843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f07d6-5389-4df6-85b2-fe0afb4b4ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:18.396011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f07d6-5389-4df6-85b2-fe0afb4b4ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:18.414315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-024f07d6-5389-4df6-85b2-fe0afb4b4ca7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:18.415508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-024f07d6-5389-4df6-85b2-fe0afb4b4ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:18.423157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 744/1475] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:18.470319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9c27f-72b1-40eb-85aa-96767cf3e439 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:18.470613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9c27f-72b1-40eb-85aa-96767cf3e439 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:18.470893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9c27f-72b1-40eb-85aa-96767cf3e439 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:18.472680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 732/1476] 10.222.0.23 () {54 vars in 961 bytes} [Tue Apr 26 14:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:18.477510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab10ca4-4a89-4661-b618-8190ca838d7f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:18.477808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab10ca4-4a89-4661-b618-8190ca838d7f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:18.478148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab10ca4-4a89-4661-b618-8190ca838d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:18.496124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6ab10ca4-4a89-4661-b618-8190ca838d7f None None] MFA Rules not processed for user `2132fa7fbd034deb938e9032ec710d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:18.497316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6ab10ca4-4a89-4661-b618-8190ca838d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:18.503724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 745/1477] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Apr 26 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:18.511793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9c27f-72b1-40eb-85aa-96767cf3e439 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:18.522056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9c27f-72b1-40eb-85aa-96767cf3e439 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:18.526109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d60e8d-52d9-430e-86d4-0a6f58be344f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:18.526736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60e8d-52d9-430e-86d4-0a6f58be344f service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:18.527021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60e8d-52d9-430e-86d4-0a6f58be344f service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:18.527293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d60e8d-52d9-430e-86d4-0a6f58be344f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:18.535839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d60e8d-52d9-430e-86d4-0a6f58be344f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:18.537251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d60e8d-52d9-430e-86d4-0a6f58be344f service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:18.546586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 733/1478] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:04:20.870987 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec5ec-bd25-4f1e-bda9-28002c5ef3a8 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:20.871554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec5ec-bd25-4f1e-bda9-28002c5ef3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:20.871554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ec5ec-bd25-4f1e-bda9-28002c5ef3a8 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:20.873317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 746/1479] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:20.878659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb97ec-4196-4395-aeb9-a2faaff4424f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:20.879112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb97ec-4196-4395-aeb9-a2faaff4424f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:20.879218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb97ec-4196-4395-aeb9-a2faaff4424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:20.896418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-50fb97ec-4196-4395-aeb9-a2faaff4424f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:20.897615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-50fb97ec-4196-4395-aeb9-a2faaff4424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:20.906133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 734/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:20.930167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec5ec-bd25-4f1e-bda9-28002c5ef3a8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:20.942386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ec5ec-bd25-4f1e-bda9-28002c5ef3a8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:20.946746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc5cb-aef4-401e-91d7-baad73ef1d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:20.951680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc5cb-aef4-401e-91d7-baad73ef1d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:20.951680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc5cb-aef4-401e-91d7-baad73ef1d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:20.951680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc5cb-aef4-401e-91d7-baad73ef1d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:20.951680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fc5cb-aef4-401e-91d7-baad73ef1d7d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:20.951680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fc5cb-aef4-401e-91d7-baad73ef1d7d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:20.964079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 747/1481] 10.222.0.23 () {56 vars in 1108 bytes} [Tue Apr 26 14:04:20 2022] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:04:23.239436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0bce-a767-47fc-840c-7fba206c890e None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:23.239946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0bce-a767-47fc-840c-7fba206c890e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:23.240134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0bce-a767-47fc-840c-7fba206c890e None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:23.241832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 735/1482] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:23.247504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075aaf7-7887-4de3-8914-e61d7fd8c179 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:23.247934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075aaf7-7887-4de3-8914-e61d7fd8c179 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:23.248070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075aaf7-7887-4de3-8914-e61d7fd8c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:23.265917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9075aaf7-7887-4de3-8914-e61d7fd8c179 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:23.267133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9075aaf7-7887-4de3-8914-e61d7fd8c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:23.274787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 748/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:23.315211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca0bce-a767-47fc-840c-7fba206c890e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:23.329847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca0bce-a767-47fc-840c-7fba206c890e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:23.335286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0880d-6aed-4f9c-8cf4-0ab9c22d768e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:23.335912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0880d-6aed-4f9c-8cf4-0ab9c22d768e service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:23.336197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0880d-6aed-4f9c-8cf4-0ab9c22d768e service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:23.336474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0880d-6aed-4f9c-8cf4-0ab9c22d768e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:23.344524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0880d-6aed-4f9c-8cf4-0ab9c22d768e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:23.346150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0880d-6aed-4f9c-8cf4-0ab9c22d768e service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:23.355342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 736/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:04:25.804064 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825876b-3313-450f-a771-f55b988e5c8f None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:25.804642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825876b-3313-450f-a771-f55b988e5c8f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:25.804642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825876b-3313-450f-a771-f55b988e5c8f None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:25.807099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 749/1485] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 14:04:25.812314 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a2c2-588e-4da6-a7b2-ea141aefa22a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:25.812740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a2c2-588e-4da6-a7b2-ea141aefa22a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:25.812848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355a2c2-588e-4da6-a7b2-ea141aefa22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:25.830060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-5355a2c2-588e-4da6-a7b2-ea141aefa22a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:25.831230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-5355a2c2-588e-4da6-a7b2-ea141aefa22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:25.838821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 737/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:25.874817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825876b-3313-450f-a771-f55b988e5c8f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:25.885307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825876b-3313-450f-a771-f55b988e5c8f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:25.888812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af6342-e57e-40f5-8e74-9211ae0495a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:25.889434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af6342-e57e-40f5-8e74-9211ae0495a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:25.889708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af6342-e57e-40f5-8e74-9211ae0495a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:25.890009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af6342-e57e-40f5-8e74-9211ae0495a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:25.898538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af6342-e57e-40f5-8e74-9211ae0495a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:25.899945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af6342-e57e-40f5-8e74-9211ae0495a3 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:25.908918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 750/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:04:28.218099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab638-57ca-4c1c-aeb7-18d5218bd120 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:28.218660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab638-57ca-4c1c-aeb7-18d5218bd120 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:28.218660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aab638-57ca-4c1c-aeb7-18d5218bd120 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:28.220413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 738/1488] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:28.225640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96dfe5-2852-4e34-9c32-4e9ac601d496 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:28.226060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96dfe5-2852-4e34-9c32-4e9ac601d496 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:28.226262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96dfe5-2852-4e34-9c32-4e9ac601d496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:28.243751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-eb96dfe5-2852-4e34-9c32-4e9ac601d496 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:28.245005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-eb96dfe5-2852-4e34-9c32-4e9ac601d496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:28.252807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 751/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:28.290714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab638-57ca-4c1c-aeb7-18d5218bd120 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:28.300954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aab638-57ca-4c1c-aeb7-18d5218bd120 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:28.304462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96285dc6-132d-42d1-98a9-1d070f26e529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:28.305086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285dc6-132d-42d1-98a9-1d070f26e529 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:28.305368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285dc6-132d-42d1-98a9-1d070f26e529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:28.305660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96285dc6-132d-42d1-98a9-1d070f26e529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:28.314203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285dc6-132d-42d1-98a9-1d070f26e529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:28.315631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96285dc6-132d-42d1-98a9-1d070f26e529 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:28.325190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 739/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:04:30.684183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52516f-fb18-4a0b-8f32-5426f15a14d0 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:30.684808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52516f-fb18-4a0b-8f32-5426f15a14d0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:30.684808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52516f-fb18-4a0b-8f32-5426f15a14d0 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:30.686616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 752/1491] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:30.691959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521a5c-55fa-4560-a75e-66f2caee3959 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:30.692398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521a5c-55fa-4560-a75e-66f2caee3959 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:30.692505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521a5c-55fa-4560-a75e-66f2caee3959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:30.711232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-8a521a5c-55fa-4560-a75e-66f2caee3959 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:30.712452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8a521a5c-55fa-4560-a75e-66f2caee3959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:30.720151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 740/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:30.760515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52516f-fb18-4a0b-8f32-5426f15a14d0 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:30.771135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52516f-fb18-4a0b-8f32-5426f15a14d0 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:30.774715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88554277-2a52-47f4-a577-92419edfbf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:30.775349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88554277-2a52-47f4-a577-92419edfbf4c service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:30.775640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88554277-2a52-47f4-a577-92419edfbf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:30.775918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88554277-2a52-47f4-a577-92419edfbf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:30.784683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88554277-2a52-47f4-a577-92419edfbf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:30.786145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88554277-2a52-47f4-a577-92419edfbf4c service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:30.795654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 753/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:04:33.443023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0005b0-4a4a-4036-91b0-936001c4e5e9 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:33.443502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0005b0-4a4a-4036-91b0-936001c4e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:33.443598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0005b0-4a4a-4036-91b0-936001c4e5e9 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:33.445371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 741/1494] 10.222.0.23 () {54 vars in 926 bytes} [Tue Apr 26 14:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:04:33.451338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c874ef3-5d0b-4436-9f6f-dfffee4ac759 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:33.451732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c874ef3-5d0b-4436-9f6f-dfffee4ac759 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:33.451822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c874ef3-5d0b-4436-9f6f-dfffee4ac759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:33.470664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3c874ef3-5d0b-4436-9f6f-dfffee4ac759 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:04:33.471875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3c874ef3-5d0b-4436-9f6f-dfffee4ac759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:04:33.479646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 754/1495] 10.222.0.23 () {58 vars in 1023 bytes} [Tue Apr 26 14:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:04:33.518052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0005b0-4a4a-4036-91b0-936001c4e5e9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:04:33.529140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0005b0-4a4a-4036-91b0-936001c4e5e9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:04:33.532625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea793a-83f3-496e-967a-c6698ce33daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:04:33.533252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea793a-83f3-496e-967a-c6698ce33daf service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:04:33.533533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea793a-83f3-496e-967a-c6698ce33daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:04:33.533804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea793a-83f3-496e-967a-c6698ce33daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:04:33.542847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea793a-83f3-496e-967a-c6698ce33daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:04:33.544286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea793a-83f3-496e-967a-c6698ce33daf service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:04:33.553702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 742/1496] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:06:22.581504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:22.582107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:22.582107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:22.600409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:06:22.601615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:06:22.610319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 755/1497] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:06:22.618559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:22.619060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:22.619167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:22.636931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:06:22.638146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:06:22.646253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 743/1498] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:06:22.650882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:22.660376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65a7c-8d8a-459f-986a-2c355edbb88a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:22.665093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:22.666415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:22.666697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:22.666970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:22.667700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:06:22.668005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:22.669012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:22.669012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:06:22.669012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:06:22.669887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:22.680967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 756/1499] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:06:22.688592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:22.697912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dbc2e0-b3f1-4a88-985e-8afa068b4be6 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:22.702344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:22.702983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:22.703264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:22.703537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:22.704230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:22.705929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:22.705929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:06:22.705929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:06:22.707157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:22.798341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 744/1500] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:06:22 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:06:22.802540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:22.812635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f9cca-73ef-4d35-92c4-c0a0ee981ea2 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:22.866216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:22.866877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:22.867163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:22.867442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:22.868140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:22.869151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:22.869151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:06:22.869151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:06:22.870389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:22.946907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 757/1501] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:06:22 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:06:22.951190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:22.961066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402ea34-e818-4e0c-bf1c-e68654e58307 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:22.965531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:22.966219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:22.966507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:22.966788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:22.967506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:22.968518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:22.968518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:06:22.968518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:06:22.969403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:22.982220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 745/1502] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:06:22.986013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:22.996347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c165b-206e-414a-a898-72e6bb1b6903 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:23.000784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:23.001430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.001717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.002021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.002747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:23.003750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:23.003750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:06:23.003750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:06:23.004628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499852e9-2345-44f4-b470-7f12c6c121a6 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:23.018245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 758/1503] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:06:23.022330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:23.032715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6198da4-4420-4fd7-bebd-24b066541441 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:23.037160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:23.038319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.038604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.038878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] PATH_INFO: `/v3/projects/0eacc47b191246cabb9feb2e85112a19/users/673a6c81dbb3402485a959e795b37978/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.052883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eacc47b191246cabb9feb2e85112a19, user_id=673a6c81dbb3402485a959e795b37978, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:23.053915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:23.053915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:06:23.053915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:06:23.056396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:23.173960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 746/1504] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:06:23 2022] PUT /identity/v3/projects/0eacc47b191246cabb9feb2e85112a19/users/673a6c81dbb3402485a959e795b37978/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:06:23.185749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fec81-5100-4488-b760-90b7ec948ca7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.186071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fec81-5100-4488-b760-90b7ec948ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.186349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fec81-5100-4488-b760-90b7ec948ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.212328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-f21fec81-5100-4488-b760-90b7ec948ca7 None None] MFA Rules not processed for user `673a6c81dbb3402485a959e795b37978`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:06:23.213445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f21fec81-5100-4488-b760-90b7ec948ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:06:23.273277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 759/1505] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:06:23.284526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:23.351991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c353a-2722-49be-9446-589482fb3407 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:23.357328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:23.357979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.358274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.358548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.365914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:23.367505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:23.376349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 747/1506] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:06:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:06:23.447075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeffd8-2f06-448d-b384-71b75fd7f288 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.447368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeffd8-2f06-448d-b384-71b75fd7f288 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.447644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffeffd8-2f06-448d-b384-71b75fd7f288 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.449405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 760/1507] 10.222.0.23 () {52 vars in 829 bytes} [Tue Apr 26 14:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:06:23.452998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:23.511942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4155ba6-9596-4de5-b98a-9b468d4ab4c0 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:23.516435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:23.517294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.517569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.517846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] PATH_INFO: `/v3/users/673a6c81dbb3402485a959e795b37978` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.519063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] RBAC: Authorizing `identity:delete_user(user_id=673a6c81dbb3402485a959e795b37978)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:23.520061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:23.520061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:06:23.520061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:06:23.521249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:23.725434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673a6c81dbb3402485a959e795b37978'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:23.743033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673a6c81dbb3402485a959e795b37978'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:23.743884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673a6c81dbb3402485a959e795b37978'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:23.755554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673a6c81dbb3402485a959e795b37978'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:23.756209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673a6c81dbb3402485a959e795b37978'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:23.849872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 748/1508] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:06:23 2022] DELETE /identity/v3/users/673a6c81dbb3402485a959e795b37978 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:06:23.854391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:23.854863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:23.854977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:23.872857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:06:23.874102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:06:23.931728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 761/1509] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:06:23.941092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:23.942602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:06:23.996228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f96b7-156c-46d9-a316-3583b923070f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:23.999829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655f44-509e-4000-bc50-9e8e5056f065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:24.000502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655f44-509e-4000-bc50-9e8e5056f065 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:24.000782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655f44-509e-4000-bc50-9e8e5056f065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:24.001056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655f44-509e-4000-bc50-9e8e5056f065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:24.009761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655f44-509e-4000-bc50-9e8e5056f065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:24.011237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655f44-509e-4000-bc50-9e8e5056f065 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:24.020321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 749/1510] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:06:24.486128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:06:24.487683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:06:24.500174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68228f4c-fa1c-4c96-9ef5-4adf19d932bd None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:06:24.505415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:06:24.506345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:06:24.506632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:06:24.506945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] PATH_INFO: `/v3/projects/0eacc47b191246cabb9feb2e85112a19` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:06:24.509677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eacc47b191246cabb9feb2e85112a19)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:06:24.511123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:06:24.511123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:06:24.511123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:06:24.512408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:06:24.620332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eacc47b191246cabb9feb2e85112a19', 'request_id': 'req-9a36aba2-698c-4ee3-8da8-9f965636e51f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:24.707209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eacc47b191246cabb9feb2e85112a19', 'request_id': 'req-9a36aba2-698c-4ee3-8da8-9f965636e51f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:24.713516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eacc47b191246cabb9feb2e85112a19', 'request_id': 'req-9a36aba2-698c-4ee3-8da8-9f965636e51f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:24.731141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] The token cache is being invalidate because project 0eacc47b191246cabb9feb2e85112a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:06:24.731442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:24.732157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9a36aba2-698c-4ee3-8da8-9f965636e51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:06:24.733707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 762/1511] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:06:24 2022] DELETE /identity/v3/projects/0eacc47b191246cabb9feb2e85112a19 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:08:05.340306 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b3ef-a8dc-4a94-a47a-86037e94f12e None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:05.340844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b3ef-a8dc-4a94-a47a-86037e94f12e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:05.340949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b3ef-a8dc-4a94-a47a-86037e94f12e None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:05.343143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 750/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 14:08:05.347725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe01cc-710b-4277-b5a3-c3ffb3b336c6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:05.349665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe01cc-710b-4277-b5a3-c3ffb3b336c6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:05.349665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbe01cc-710b-4277-b5a3-c3ffb3b336c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:05.366850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8dbe01cc-710b-4277-b5a3-c3ffb3b336c6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:05.368053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8dbe01cc-710b-4277-b5a3-c3ffb3b336c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:05.426466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 763/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:05.577628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b3ef-a8dc-4a94-a47a-86037e94f12e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:05.580254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1c01b3ef-a8dc-4a94-a47a-86037e94f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:05.656208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b3ef-a8dc-4a94-a47a-86037e94f12e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:05.662091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321644f-6975-4bc2-b901-d85ec424bc3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:05.662741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321644f-6975-4bc2-b901-d85ec424bc3d service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:05.663279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321644f-6975-4bc2-b901-d85ec424bc3d service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:05.663556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321644f-6975-4bc2-b901-d85ec424bc3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:05.671520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321644f-6975-4bc2-b901-d85ec424bc3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:05.673103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321644f-6975-4bc2-b901-d85ec424bc3d service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:05.682898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 751/1514] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:05.835855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c90c-25ec-455b-b02e-857b4fe47d21 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:05.836066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c90c-25ec-455b-b02e-857b4fe47d21 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:05.836327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c90c-25ec-455b-b02e-857b4fe47d21 None None] PATH_INFO: `/v3` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:05.837631 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 764/1515] 10.222.0.26 () {54 vars in 925 bytes} [Tue Apr 26 14:08:05 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:08:05.844453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d274c-8cc4-465e-aaa1-219e49ea14e3 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:05.844744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d274c-8cc4-465e-aaa1-219e49ea14e3 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:05.845560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d274c-8cc4-465e-aaa1-219e49ea14e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:05.863108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b42d274c-8cc4-465e-aaa1-219e49ea14e3 None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:05.864976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b42d274c-8cc4-465e-aaa1-219e49ea14e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:05.936476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 752/1516] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Apr 26 14:08:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:08:06.957940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b9219-b4d2-48ab-a26d-28cf52de4e94 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:06.958533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b9219-b4d2-48ab-a26d-28cf52de4e94 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:06.958533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b9219-b4d2-48ab-a26d-28cf52de4e94 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:06.960312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 765/1517] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:06.965323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54698e40-9907-4fc0-9de8-cc793be9ea97 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:06.965727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54698e40-9907-4fc0-9de8-cc793be9ea97 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:06.965906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54698e40-9907-4fc0-9de8-cc793be9ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:06.984295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-54698e40-9907-4fc0-9de8-cc793be9ea97 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:06.985541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-54698e40-9907-4fc0-9de8-cc793be9ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:06.993204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 753/1518] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:07.145848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b9219-b4d2-48ab-a26d-28cf52de4e94 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:07.160253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b9219-b4d2-48ab-a26d-28cf52de4e94 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:07.165939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefb5bc-d8d5-4533-886a-af895278c310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:07.166606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefb5bc-d8d5-4533-886a-af895278c310 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:07.166889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefb5bc-d8d5-4533-886a-af895278c310 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:07.167167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefb5bc-d8d5-4533-886a-af895278c310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:07.175269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefb5bc-d8d5-4533-886a-af895278c310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:07.176861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefb5bc-d8d5-4533-886a-af895278c310 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:07.186048 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 766/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:10.110759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfe08-2118-4f36-898f-d3348df56e58 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:10.111221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfe08-2118-4f36-898f-d3348df56e58 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:10.111334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedfe08-2118-4f36-898f-d3348df56e58 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:10.113669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 754/1520] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 26 14:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:10.118854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b600f2-ffbb-436b-b2a3-0c32588b9406 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:10.119250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b600f2-ffbb-436b-b2a3-0c32588b9406 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:10.119413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b600f2-ffbb-436b-b2a3-0c32588b9406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:10.137375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-76b600f2-ffbb-436b-b2a3-0c32588b9406 None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:10.138638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-76b600f2-ffbb-436b-b2a3-0c32588b9406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:10.147149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 767/1521] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 26 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:10.154977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedfe08-2118-4f36-898f-d3348df56e58 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:10.169120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedfe08-2118-4f36-898f-d3348df56e58 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:10.175084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24997465-8233-4c92-8eb2-eecc17062daa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952f39b205c74255a2776e7fec3b8643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:10.175713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997465-8233-4c92-8eb2-eecc17062daa service placement] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:10.175993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997465-8233-4c92-8eb2-eecc17062daa service placement] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:10.176266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997465-8233-4c92-8eb2-eecc17062daa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:10.184392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997465-8233-4c92-8eb2-eecc17062daa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:10.185955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997465-8233-4c92-8eb2-eecc17062daa service placement] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:10.195206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 755/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:08:18.839121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66146-09f1-4404-9b73-bd1cacc8b613 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:18.839707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66146-09f1-4404-9b73-bd1cacc8b613 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:18.839857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f66146-09f1-4404-9b73-bd1cacc8b613 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:18.841576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 768/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:18.846749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb6dca-b9e1-405f-a69b-e292435386c3 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:18.847181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb6dca-b9e1-405f-a69b-e292435386c3 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:18.847929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb6dca-b9e1-405f-a69b-e292435386c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:18.865583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dddb6dca-b9e1-405f-a69b-e292435386c3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:18.866782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dddb6dca-b9e1-405f-a69b-e292435386c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:18.874834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 756/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:19.021992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66146-09f1-4404-9b73-bd1cacc8b613 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:19.036557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f66146-09f1-4404-9b73-bd1cacc8b613 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:19.042185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97404c2-d97a-47b4-817c-552924b7b194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:19.042814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97404c2-d97a-47b4-817c-552924b7b194 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:19.043099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97404c2-d97a-47b4-817c-552924b7b194 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:19.043378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97404c2-d97a-47b4-817c-552924b7b194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:19.051876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97404c2-d97a-47b4-817c-552924b7b194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:19.053438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97404c2-d97a-47b4-817c-552924b7b194 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:19.062864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 769/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:20.308764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7cb6-192f-4e04-8c20-26472cbcd5cb None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:20.309339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7cb6-192f-4e04-8c20-26472cbcd5cb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:20.309339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b7cb6-192f-4e04-8c20-26472cbcd5cb None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:20.311184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 757/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 26 14:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:20.315976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0074756-fdf9-453a-a6fa-081fa53ea80e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:20.316464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0074756-fdf9-453a-a6fa-081fa53ea80e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:20.316571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0074756-fdf9-453a-a6fa-081fa53ea80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:20.334767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a0074756-fdf9-453a-a6fa-081fa53ea80e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:20.335959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a0074756-fdf9-453a-a6fa-081fa53ea80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:20.343622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 770/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 26 14:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:20.494089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7cb6-192f-4e04-8c20-26472cbcd5cb None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:20.507931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b7cb6-192f-4e04-8c20-26472cbcd5cb None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:20.513200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e412db-6821-49d4-8a60-8d1e4992cd26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:20.513830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e412db-6821-49d4-8a60-8d1e4992cd26 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:20.514153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e412db-6821-49d4-8a60-8d1e4992cd26 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:20.514428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e412db-6821-49d4-8a60-8d1e4992cd26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:20.522311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e412db-6821-49d4-8a60-8d1e4992cd26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:20.523888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e412db-6821-49d4-8a60-8d1e4992cd26 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:20.532933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 758/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:24.656551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d750-8c91-4ff8-8795-7a4478977323 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:24.657106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d750-8c91-4ff8-8795-7a4478977323 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:24.657106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758d750-8c91-4ff8-8795-7a4478977323 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:24.658948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 771/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:24.664922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffdb29-35a2-4fcf-8166-fc0e31a82e22 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:24.665347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffdb29-35a2-4fcf-8166-fc0e31a82e22 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:24.665477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffdb29-35a2-4fcf-8166-fc0e31a82e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:24.683042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dfffdb29-35a2-4fcf-8166-fc0e31a82e22 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:24.684223 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dfffdb29-35a2-4fcf-8166-fc0e31a82e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:24.692208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 759/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:08:24.728289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d750-8c91-4ff8-8795-7a4478977323 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:24.729985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a758d750-8c91-4ff8-8795-7a4478977323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:24.785300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758d750-8c91-4ff8-8795-7a4478977323 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:24.789145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c35df4-c8d6-4da3-bd9d-18fb0c4ec4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:24.789784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c35df4-c8d6-4da3-bd9d-18fb0c4ec4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:24.790106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c35df4-c8d6-4da3-bd9d-18fb0c4ec4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:24.790391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c35df4-c8d6-4da3-bd9d-18fb0c4ec4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:24.799252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c35df4-c8d6-4da3-bd9d-18fb0c4ec4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:24.801282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c35df4-c8d6-4da3-bd9d-18fb0c4ec4c4 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:24.810548 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 772/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:27.065157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32aa15-9e29-47f2-85ff-a702060c880d None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:27.065717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32aa15-9e29-47f2-85ff-a702060c880d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:27.065717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32aa15-9e29-47f2-85ff-a702060c880d None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:27.068046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 760/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:27.073229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973d67-cc3e-4dcb-9659-3d1c0958d956 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:27.073636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973d67-cc3e-4dcb-9659-3d1c0958d956 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:27.073788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65973d67-cc3e-4dcb-9659-3d1c0958d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:27.091553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-65973d67-cc3e-4dcb-9659-3d1c0958d956 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:27.092733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-65973d67-cc3e-4dcb-9659-3d1c0958d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:27.100420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 773/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:27.135881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32aa15-9e29-47f2-85ff-a702060c880d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:27.146821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32aa15-9e29-47f2-85ff-a702060c880d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:27.150327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa717bb4-3e3f-46f5-864d-0520993d7de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:27.150957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717bb4-3e3f-46f5-864d-0520993d7de5 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:27.151238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717bb4-3e3f-46f5-864d-0520993d7de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:27.151513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa717bb4-3e3f-46f5-864d-0520993d7de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:27.160140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa717bb4-3e3f-46f5-864d-0520993d7de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:27.161571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa717bb4-3e3f-46f5-864d-0520993d7de5 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:27.171339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 761/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:30.950562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7a067-39ee-406a-8521-d96fc271025e None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:30.951159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7a067-39ee-406a-8521-d96fc271025e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:30.951159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7a067-39ee-406a-8521-d96fc271025e None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:30.952933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 774/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:30.958708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc92ee-f011-4be1-a273-06b7f2fcc444 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:30.959152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc92ee-f011-4be1-a273-06b7f2fcc444 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:30.959269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc92ee-f011-4be1-a273-06b7f2fcc444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:30.976816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-93cc92ee-f011-4be1-a273-06b7f2fcc444 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:30.978023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-93cc92ee-f011-4be1-a273-06b7f2fcc444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:30.985713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 762/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:08:31.242520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7a067-39ee-406a-8521-d96fc271025e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:31.244296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-62b7a067-39ee-406a-8521-d96fc271025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:31.300677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7a067-39ee-406a-8521-d96fc271025e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:31.304269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461509-7c6c-4d85-a7dd-856ac8b67c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:31.304904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461509-7c6c-4d85-a7dd-856ac8b67c8d service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:31.305189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461509-7c6c-4d85-a7dd-856ac8b67c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:31.305467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461509-7c6c-4d85-a7dd-856ac8b67c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:31.314245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461509-7c6c-4d85-a7dd-856ac8b67c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:31.315667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461509-7c6c-4d85-a7dd-856ac8b67c8d service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:31.331982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 775/1537] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:08:33.641023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bf78a-a2bb-45a8-b220-6dece4484bb7 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:33.641549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bf78a-a2bb-45a8-b220-6dece4484bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:33.641549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6bf78a-a2bb-45a8-b220-6dece4484bb7 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:33.643276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 763/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 26 14:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:33.648443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec242bb-0265-441e-9c60-8ace1dc7f451 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:33.648887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec242bb-0265-441e-9c60-8ace1dc7f451 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:33.649035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec242bb-0265-441e-9c60-8ace1dc7f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:33.668295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5ec242bb-0265-441e-9c60-8ace1dc7f451 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:33.669500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5ec242bb-0265-441e-9c60-8ace1dc7f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:33.677789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 776/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 26 14:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:33.929220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045106-14d6-42f0-9798-12e769dd51b1 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:33.929505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045106-14d6-42f0-9798-12e769dd51b1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:33.929779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40045106-14d6-42f0-9798-12e769dd51b1 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:33.931561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 764/1540] 10.222.0.23 () {54 vars in 961 bytes} [Tue Apr 26 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:08:33.936513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3527-7b62-4a41-9a40-502743619c9e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:33.936801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3527-7b62-4a41-9a40-502743619c9e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:33.937077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd3527-7b62-4a41-9a40-502743619c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:33.954929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-dbdd3527-7b62-4a41-9a40-502743619c9e None None] MFA Rules not processed for user `57a82877b3b14091b942181b4887edff`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:08:33.956165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dbdd3527-7b62-4a41-9a40-502743619c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:08:33.963030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 777/1541] 10.222.0.23 () {58 vars in 1058 bytes} [Tue Apr 26 14:08:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:08:33.972662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045106-14d6-42f0-9798-12e769dd51b1 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:08:33.982948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40045106-14d6-42f0-9798-12e769dd51b1 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:08:33.986436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd8b67-ed9b-4d52-9b9b-9fbcb4673bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:08:33.987052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd8b67-ed9b-4d52-9b9b-9fbcb4673bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:08:33.987334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd8b67-ed9b-4d52-9b9b-9fbcb4673bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:08:33.987636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd8b67-ed9b-4d52-9b9b-9fbcb4673bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:08:33.996237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd8b67-ed9b-4d52-9b9b-9fbcb4673bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:08:33.997655 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd8b67-ed9b-4d52-9b9b-9fbcb4673bc1 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:08:34.006891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 765/1542] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:06.316242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.317448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.318136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.343133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.344384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.356856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 778/1543] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.367699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.368299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.368299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.390268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.391500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.403644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 766/1544] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.408308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:06.419563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b51b6-c2ee-4297-80ee-45663c340e23 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:06.430353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:06.431038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.431329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.431612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.432396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:06.432713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:06.450597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6e1d9-8902-4ccd-ab8a-e7ebddcf45fb admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:06.465327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 779/1545] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:10:06.474611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:06.487734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f772a0a-c60d-4c5a-88e9-9ef9fea9ff8a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:06.495969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:06.496675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.496998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.497226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.497955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:06.500438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:06.588293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561bb56-b8bc-4aa0-98d3-b66221ddd93c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.588692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561bb56-b8bc-4aa0-98d3-b66221ddd93c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.588922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561bb56-b8bc-4aa0-98d3-b66221ddd93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.620130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 767/1546] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:06.621301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d561bb56-b8bc-4aa0-98d3-b66221ddd93c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.626195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:06.627176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d561bb56-b8bc-4aa0-98d3-b66221ddd93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.734617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 780/1547] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:06.736032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef36b3f-b4fe-41de-80c1-ccc2b72bd796 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.736330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef36b3f-b4fe-41de-80c1-ccc2b72bd796 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.736609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef36b3f-b4fe-41de-80c1-ccc2b72bd796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.740330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf617f-f541-4f45-a220-56686e934ab9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:06.757142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7ef36b3f-b4fe-41de-80c1-ccc2b72bd796 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.758561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7ef36b3f-b4fe-41de-80c1-ccc2b72bd796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.769755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:06.770557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.770844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.771600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.771838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:06.772955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:10:06.772955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:10:06.772955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:10:06.774177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4019c-7730-4502-bd30-1b1512029f42 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:06.789203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 781/1548] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.790392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec5e5-ef87-4ead-bb53-f3906c469a23 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.790689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec5e5-ef87-4ead-bb53-f3906c469a23 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.790972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cec5e5-ef87-4ead-bb53-f3906c469a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.816691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-67cec5e5-ef87-4ead-bb53-f3906c469a23 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.817898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-67cec5e5-ef87-4ead-bb53-f3906c469a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.825881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 782/1549] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.827165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c966-cca8-403c-b164-931ce0b8eaca None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.827452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c966-cca8-403c-b164-931ce0b8eaca None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.827797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642c966-cca8-403c-b164-931ce0b8eaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.846820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d642c966-cca8-403c-b164-931ce0b8eaca None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.848000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d642c966-cca8-403c-b164-931ce0b8eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.856052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 783/1550] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.857478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa58cc-6744-471d-97da-946a4c87423f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.857867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa58cc-6744-471d-97da-946a4c87423f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.858271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa58cc-6744-471d-97da-946a4c87423f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.868672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 768/1551] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:06.871701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd606f-c9ea-47a8-b2b8-98f1146938b4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.871701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd606f-c9ea-47a8-b2b8-98f1146938b4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.871701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd606f-c9ea-47a8-b2b8-98f1146938b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.878113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-10aa58cc-6744-471d-97da-946a4c87423f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.880061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-10aa58cc-6744-471d-97da-946a4c87423f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.888695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 784/1552] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.890171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53ca8-9268-427d-b064-cf26ccf0b6f7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.890558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53ca8-9268-427d-b064-cf26ccf0b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.890932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53ca8-9268-427d-b064-cf26ccf0b6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.896277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4abd606f-c9ea-47a8-b2b8-98f1146938b4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.897809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4abd606f-c9ea-47a8-b2b8-98f1146938b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.907801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 769/1553] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.909176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.909467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.909744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.913003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-40c53ca8-9268-427d-b064-cf26ccf0b6f7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.914377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-40c53ca8-9268-427d-b064-cf26ccf0b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.922713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 785/1554] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.924115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.924470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.924817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.929202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.930576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.938398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 770/1555] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.942114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:06.943322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.944492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.948399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd650c6-265e-4e5f-9a58-a1d7ddbc6adc None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:06.952692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 786/1556] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:06.952889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:06.953524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.953806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.953919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:06.954116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.954831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:06.955137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:06.956210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:10:06.956210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:10:06.956210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:10:06.957573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ed72d-7e86-42a6-be71-63f77fb20b5e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:06.964268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7e614-65c5-4172-8457-45ab6abc6385 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:06.968770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a1fa-2a89-4888-b7bd-d63637068f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:06.968968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 771/1557] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:06.969408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a1fa-2a89-4888-b7bd-d63637068f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.969813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a1fa-2a89-4888-b7bd-d63637068f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.970134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a1fa-2a89-4888-b7bd-d63637068f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.970434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea06f-353a-42cf-a3ff-e390aee5aee7 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.970790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea06f-353a-42cf-a3ff-e390aee5aee7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.970890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782a1fa-2a89-4888-b7bd-d63637068f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:06.971177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea06f-353a-42cf-a3ff-e390aee5aee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.972567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782a1fa-2a89-4888-b7bd-d63637068f49 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:06.982654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 787/1558] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:06.983819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b63d6-576a-42f9-be6c-ad96c75d16b1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:06.984110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b63d6-576a-42f9-be6c-ad96c75d16b1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:06.984390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b63d6-576a-42f9-be6c-ad96c75d16b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:06.989954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-34fea06f-353a-42cf-a3ff-e390aee5aee7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:06.991178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-34fea06f-353a-42cf-a3ff-e390aee5aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:06.999035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 772/1559] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:07.000225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.000510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.000784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.001991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-263b63d6-576a-42f9-be6c-ad96c75d16b1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:07.003318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-263b63d6-576a-42f9-be6c-ad96c75d16b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:07.011502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 788/1560] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:07.012881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.013173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.013450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.018028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:07.019751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:07.027842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 773/1561] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:07.028522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.031252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:07.032434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:07.038387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947a6d0-d731-4d9e-a5ec-91d0a38ef920 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.041087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 789/1562] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:07.042858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.043491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.043775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.044052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.044796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:07.045100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.045288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.046821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.054439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a21b40-f13a-4b84-b4a7-21579aa8a71e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.058376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 774/1563] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:07.059161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.059803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.060085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.060361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.061083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:07.061395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.063002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.066480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.082172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 790/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:07.082365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd8c0-c543-4be2-8ecf-5ad30c6a9d56 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.082479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.082575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.082575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.082575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.082575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.082940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.084854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.086304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce57e85-1c02-45a1-b703-9c0e915f6417 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.090882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6541-59bd-40e4-baf5-ed536454ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.091513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6541-59bd-40e4-baf5-ed536454ff8b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.091798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6541-59bd-40e4-baf5-ed536454ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.092076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6541-59bd-40e4-baf5-ed536454ff8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.092830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6541-59bd-40e4-baf5-ed536454ff8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.094434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6541-59bd-40e4-baf5-ed536454ff8b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.111184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 791/1565] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:07.111184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.111184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.111184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.124463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:07.125659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:07.133640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 792/1566] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:07.140201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.143353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc5c8-e8d4-443e-a3c2-f79447485840 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.148458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.149063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.149351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.149629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.150384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:07.150693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.152272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.164241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 793/1567] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:07.164996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.173959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3891aa1-90ea-4b8a-9118-042769bed949 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.178542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.179140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.179426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.179703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.180403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:07.180709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.182254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.194222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 794/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:07.194943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 775/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.195063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.195838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.206372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765d2f3-a4c6-4918-809a-887eed801aeb admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.256707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be16b0-5853-4e0d-bf7c-0e53ab7f7a58 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.261184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.261786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.261931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.262173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.262451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.262559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.262748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.263030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.263132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.263754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:07.264064 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.265022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.265655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.276782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 795/1570] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:07.277557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.288733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db84ce-aa2c-4420-ab56-52fc7b2f58c4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.293326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:10:07.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:10:07.297693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.343102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 776/1571] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.344006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.392147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 796/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.392147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.403495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2111-3f61-48d5-b7c3-759898721073 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.452685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b5013-b907-41e0-a2f1-48f24e149265 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.457862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.458512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.458663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.458795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.459059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.459414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.459691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.459785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:07.459963 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] PATH_INFO: `/v3/projects/3f38bbf345384bdb9ed001c0965a3462/users/5adf6fccb73242bab32c2fdf0ea23ff3/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.460068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.461685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.472880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 797/1573] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:07.473599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.474840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f38bbf345384bdb9ed001c0965a3462, user_id=5adf6fccb73242bab32c2fdf0ea23ff3, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.477521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.483020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32ae7a-b372-45eb-be01-3c622d390efd admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.487525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.488156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.492741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.492741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.492741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.492741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.571247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 777/1574] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:07 2022] PUT /identity/v3/projects/3f38bbf345384bdb9ed001c0965a3462/users/5adf6fccb73242bab32c2fdf0ea23ff3/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:07.572146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.577793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 798/1575] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.578760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.632064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249370d-1870-4deb-8e84-8a22d801ad5e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.636623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.637291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.637573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.637849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.638567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.638669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7066828-d74d-425e-bcbc-d29d7d7e1f96 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.640510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.643258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.643912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.644204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.644483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.645168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.647094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.719388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 778/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.723189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.725820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 799/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.726680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.732735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d32a-bb60-49cb-8506-c984981cd742 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.790348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df9b470-6fac-441f-b54b-132a4850ca19 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.791430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.792151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.792432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.792707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.793394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.795340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.796592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.797491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.798037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.798323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.799087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.801103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.869845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 779/1578] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.869845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.880601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 800/1579] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.881753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:07.891611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6bcf4-cb16-430b-ba10-7fff8e8785cd admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.928792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b9986-a4e6-4bad-a17f-490fb63e6995 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:07.933361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e492f73d-ffb2-4183-8b53-30f53c47dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.934026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f73d-ffb2-4183-8b53-30f53c47dd55 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.934309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f73d-ffb2-4183-8b53-30f53c47dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.934607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492f73d-ffb2-4183-8b53-30f53c47dd55 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.935297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492f73d-ffb2-4183-8b53-30f53c47dd55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.937207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e492f73d-ffb2-4183-8b53-30f53c47dd55 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.946574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:07.947347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.947654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.947938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:07.948629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:07.950557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:07.993897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 780/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:07.995213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:07.995503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:07.995783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.013186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:08.021229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:08.021364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 801/1581] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:08.021364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.025313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 781/1582] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:08.026244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.035769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319bf33f-0e25-48b5-badf-bc9be8852587 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.084083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0cde8-97c2-42c5-93cd-7d4e4ff7d57e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.089226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.090123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.090291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.090642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.090934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.091100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.091212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.091470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.092072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.092184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.093772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.094282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.107293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 782/1583] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.107293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.115480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093e43-e5c2-4ccc-9a78-3c4796dd949c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.122101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.122101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.122101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.122101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.122510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.124062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.205096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 802/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:08 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:08.206210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.211062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 783/1585] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:08 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:08.211965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.217519 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a67b41e-ce0e-40c4-95b9-2e23a952021a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.221166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f7a5b-0f94-4d39-8367-c93511c5c244 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.222902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.223650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.224006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.224353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.225179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.226411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.227054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.227171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.227336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.227615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.228326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.229903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.240996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 784/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.242139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.251182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f016e74-0dfc-4e15-9d2a-32dcb269d7b0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.255667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.256275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.256552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.256820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.257501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.259067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.268287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 785/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.269069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.278164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c4af1-9457-4a65-bfc0-f3461869911f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.282527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.283105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.283379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.283645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.284284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.286629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.337144 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 803/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:08 2022] POST /identity/v3/users => generated 302 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:08.337991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.389243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a74b46-8029-4330-86f6-09de0906a9ad admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.393240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.393810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 786/1589] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:08 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:08.393900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.394223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.401179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.401312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.404882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.406275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ca11-7afd-4b2b-8712-374b0b482c48 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.406692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.410984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.411658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.411933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.412205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.413186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.414912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.416137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 804/1590] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:08.417245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.429209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 787/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.429388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f3cdd-04cc-4f40-bccb-b1866ed9f8d7 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.429495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.432907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.433575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.433864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.434185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.434911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.436539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.442924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961750e3-0578-4744-818b-b738d227f6f8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.450553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 805/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.450728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.450728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.450911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.450996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.450996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.450996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.452069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.459016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9a5fe-e7e8-42b9-bb05-fcb8739b4623 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.466513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 788/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.466513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.466721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.466721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.466721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.466721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.467051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.468378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.473167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789a83f-bb8d-4702-8a24-cefaf6106b79 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.477644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.478190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 806/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.478446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.478736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.478857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.478992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.479710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.481393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.489029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cff8f-7d0b-4bdb-be56-5f5a8392a0c8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.495351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 789/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.495351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.496901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.497553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.497841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.498158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.498907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.500516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.503101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94db304-aa85-42f5-920a-137c5aef98c9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.512861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.512861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.512861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.512861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.513332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.513429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 807/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.513692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.515267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.525314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8f65-7ae1-4e15-9087-c4bfe04d1676 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.528761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 790/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.529884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.533543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.534532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.534916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.538479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] PATH_INFO: `/v3/projects/3d8a12641de140b68d42fda0758a97ef/users/6c8c139c181344259612105edd7d207d/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.543217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b0c89-dfac-416c-bc77-1f04ce82f8b2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.548273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.549048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.549506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.549790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.551331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.553126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.553657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8a12641de140b68d42fda0758a97ef, user_id=6c8c139c181344259612105edd7d207d, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.554979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:10:08.554979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:10:08.554979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:10:08.557338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.563772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 791/1598] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.563772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.577602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73498b69-746a-4bc0-a9db-2a5825a80060 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.582457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.583128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.583414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.583690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.584417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.586059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.597025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 792/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.601602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.607671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb7d1-8282-462b-a2c9-82dcf93accfd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.612334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.613754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.614072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.614352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] PATH_INFO: `/v3/projects/afa3fcb59a274c22bcf1ebcf44211943/users/706ce393383a460b9b5857f74224a1fa/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.629737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa3fcb59a274c22bcf1ebcf44211943, user_id=706ce393383a460b9b5857f74224a1fa, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.632428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.656624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 808/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:08 2022] PUT /identity/v3/projects/3d8a12641de140b68d42fda0758a97ef/users/6c8c139c181344259612105edd7d207d/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:08.657370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.709061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 793/1601] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:08 2022] PUT /identity/v3/projects/afa3fcb59a274c22bcf1ebcf44211943/users/706ce393383a460b9b5857f74224a1fa/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:08.714213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.724297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e4ed6-9a4f-4b78-8848-3db201c4dad3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.773491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bd4d7-cee8-444a-bc5f-a7aeb61cf2be admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.778079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.778746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.779029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.779301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.779911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.780042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.780792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.781186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.781464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] PATH_INFO: `/v3/projects/92219fbf5acf4734907d95d02b678872/users/69cfdea1b3024bfeaac538fc26601877/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.781572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.795198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 794/1602] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.795198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.798204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92219fbf5acf4734907d95d02b678872, user_id=69cfdea1b3024bfeaac538fc26601877, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.800950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.807287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ed859-56b7-4a4f-9ceb-6f23381d7171 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.812537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.813205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.814323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.814323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.814732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.817061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.827537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 795/1603] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:08.828333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.838383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e3df1-82e8-46b5-bb07-52b1a70d0bd7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.845733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd7f7d-f2c4-42bb-8c1f-d90f0cfe0f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:08.846836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd7f7d-f2c4-42bb-8c1f-d90f0cfe0f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.847124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd7f7d-f2c4-42bb-8c1f-d90f0cfe0f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.847934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd7f7d-f2c4-42bb-8c1f-d90f0cfe0f75 admin admin] PATH_INFO: `/v3/projects/8b1983791ecd4f19a49b3aace13524ea/users/e609efce00e144819693d7e290906594/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.863160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd7f7d-f2c4-42bb-8c1f-d90f0cfe0f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1983791ecd4f19a49b3aace13524ea, user_id=e609efce00e144819693d7e290906594, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:08.865840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd7f7d-f2c4-42bb-8c1f-d90f0cfe0f75 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:08.914174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 809/1604] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:08 2022] PUT /identity/v3/projects/92219fbf5acf4734907d95d02b678872/users/69cfdea1b3024bfeaac538fc26601877/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:08.914922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:08.960239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 796/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:08 2022] PUT /identity/v3/projects/8b1983791ecd4f19a49b3aace13524ea/users/e609efce00e144819693d7e290906594/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:08.961690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00abc3-ae15-4454-a09b-0dc756f09daa None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:08.962008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00abc3-ae15-4454-a09b-0dc756f09daa None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:08.962294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00abc3-ae15-4454-a09b-0dc756f09daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:08.975111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d47e-c987-444e-9e7c-e37b1e9509b6 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:08.984479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-af00abc3-ae15-4454-a09b-0dc756f09daa None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:08.985704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-af00abc3-ae15-4454-a09b-0dc756f09daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.033417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.034496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.034818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.035104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] PATH_INFO: `/v3/projects/e7647b2a47a04782aac0cfafc3641f4c/users/5ab6476355fc4589b7554d5cb53b0b75/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.051723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 797/1606] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.053382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.053551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.053791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.057679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7647b2a47a04782aac0cfafc3641f4c, user_id=5ab6476355fc4589b7554d5cb53b0b75, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.060324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.072494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.073725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.085230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 798/1607] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.086054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.096026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9684b1-198f-46f4-8164-64bdadd510c7 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.100851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4569163-bc45-479f-9f12-c00285430f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.101742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4569163-bc45-479f-9f12-c00285430f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.103072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4569163-bc45-479f-9f12-c00285430f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.103072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4569163-bc45-479f-9f12-c00285430f96 admin admin] PATH_INFO: `/v3/projects/3889c033c96540dc97f295d397829779/users/fc7642ec7a7b475db89a7ff5c98e7e92/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.118164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4569163-bc45-479f-9f12-c00285430f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3889c033c96540dc97f295d397829779, user_id=fc7642ec7a7b475db89a7ff5c98e7e92, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.121844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4569163-bc45-479f-9f12-c00285430f96 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.126040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 810/1608] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:08 2022] PUT /identity/v3/projects/e7647b2a47a04782aac0cfafc3641f4c/users/5ab6476355fc4589b7554d5cb53b0b75/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:09.126930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.190247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcc2fd-37ee-4f77-a8b6-cbdc9da57e78 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.195725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832e06-5eb0-429b-b977-6985c3b0b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.196609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832e06-5eb0-429b-b977-6985c3b0b4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.196894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832e06-5eb0-429b-b977-6985c3b0b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.197171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832e06-5eb0-429b-b977-6985c3b0b4c9 admin admin] PATH_INFO: `/v3/projects/f655c8d396cb4e56955bc6a3be6e69c1/users/ed757ee391d647fdbd6d3d10798da228/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.205855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 799/1609] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:09 2022] PUT /identity/v3/projects/3889c033c96540dc97f295d397829779/users/fc7642ec7a7b475db89a7ff5c98e7e92/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:09.207433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.207799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.208149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.213258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832e06-5eb0-429b-b977-6985c3b0b4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f655c8d396cb4e56955bc6a3be6e69c1, user_id=ed757ee391d647fdbd6d3d10798da228, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.216272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832e06-5eb0-429b-b977-6985c3b0b4c9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.235102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] MFA Rules not processed for user `69cfdea1b3024bfeaac538fc26601877`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.236310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.274036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 811/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:09 2022] PUT /identity/v3/projects/f655c8d396cb4e56955bc6a3be6e69c1/users/ed757ee391d647fdbd6d3d10798da228/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:09.275251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.275914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.276223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.304105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] MFA Rules not processed for user `e609efce00e144819693d7e290906594`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.304880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 800/1611] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.305168 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.308993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.361326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71835b-adb1-4d1f-a1a3-5b2fe1d0efdd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.373591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 812/1612] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.374494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.409709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd095282-0aa7-43fb-b5a3-ed53f6f3e5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.411055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd095282-0aa7-43fb-b5a3-ed53f6f3e5ad service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.411693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd095282-0aa7-43fb-b5a3-ed53f6f3e5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.412128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd095282-0aa7-43fb-b5a3-ed53f6f3e5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.447597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478daaae-5cd4-44cc-97ca-f1f63f5e6810 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.451173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5617f7f-086b-47b7-a1c1-756d973a54c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.451851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5617f7f-086b-47b7-a1c1-756d973a54c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.452133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5617f7f-086b-47b7-a1c1-756d973a54c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.452408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5617f7f-086b-47b7-a1c1-756d973a54c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.478454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd095282-0aa7-43fb-b5a3-ed53f6f3e5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.480070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd095282-0aa7-43fb-b5a3-ed53f6f3e5ad service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.492119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 801/1613] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:09.493362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7994-640f-4def-8705-c26485864e69 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.493821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7994-640f-4def-8705-c26485864e69 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.494136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7994-640f-4def-8705-c26485864e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.520766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5617f7f-086b-47b7-a1c1-756d973a54c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.522239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5617f7f-086b-47b7-a1c1-756d973a54c3 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.525637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-050b7994-640f-4def-8705-c26485864e69 None None] MFA Rules not processed for user `5ab6476355fc4589b7554d5cb53b0b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.525637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-050b7994-640f-4def-8705-c26485864e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.531761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 813/1614] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:09.533194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47a49-ba73-4dc8-a1fa-46e026b4274e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.533483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47a49-ba73-4dc8-a1fa-46e026b4274e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.533761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47a49-ba73-4dc8-a1fa-46e026b4274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.554208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-11c47a49-ba73-4dc8-a1fa-46e026b4274e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.555780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-11c47a49-ba73-4dc8-a1fa-46e026b4274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.563782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 814/1615] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.567762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84083e3-5612-4564-bff9-3c8217527d07 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.568061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84083e3-5612-4564-bff9-3c8217527d07 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.568342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84083e3-5612-4564-bff9-3c8217527d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.597833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 802/1616] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.597833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b7994-640f-4def-8705-c26485864e69 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.602332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c84083e3-5612-4564-bff9-3c8217527d07 None None] MFA Rules not processed for user `ed757ee391d647fdbd6d3d10798da228`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.603901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c84083e3-5612-4564-bff9-3c8217527d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.609815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b7994-640f-4def-8705-c26485864e69 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.615372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.616163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.616604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.616777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.617624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.619654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.681567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 815/1617] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.683110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab34d-87bd-4a8b-926c-a09015679740 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.683408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab34d-87bd-4a8b-926c-a09015679740 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.683690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ab34d-87bd-4a8b-926c-a09015679740 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.690274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 816/1618] 10.222.0.23 () {54 vars in 959 bytes} [Tue Apr 26 14:10:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:09.691998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ab34d-87bd-4a8b-926c-a09015679740 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.714134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ab34d-87bd-4a8b-926c-a09015679740 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.720156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 803/1619] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:09.720156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.724852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068bdc3-6a83-4f1e-9d1f-61df231f2082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.726874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068bdc3-6a83-4f1e-9d1f-61df231f2082 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.727201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068bdc3-6a83-4f1e-9d1f-61df231f2082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.727542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068bdc3-6a83-4f1e-9d1f-61df231f2082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.745733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068bdc3-6a83-4f1e-9d1f-61df231f2082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.745733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068bdc3-6a83-4f1e-9d1f-61df231f2082 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.757427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 817/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:09.758804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a609d-f8f1-48fe-9bb6-02b12f1db0d8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.759099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a609d-f8f1-48fe-9bb6-02b12f1db0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.759395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a609d-f8f1-48fe-9bb6-02b12f1db0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.786515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c31a609d-f8f1-48fe-9bb6-02b12f1db0d8 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:09.788141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c31a609d-f8f1-48fe-9bb6-02b12f1db0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:09.824564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc243ac-b47c-42cd-af10-185966936216 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.829401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.830085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.830368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.830642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.831325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.833882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.866484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 818/1621] 10.222.0.23 () {58 vars in 1056 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:09.867822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff78ba-13a4-425f-9c49-3f7d6bf3bd73 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.868116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff78ba-13a4-425f-9c49-3f7d6bf3bd73 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.868566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff78ba-13a4-425f-9c49-3f7d6bf3bd73 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.874974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 819/1622] 10.222.0.23 () {54 vars in 959 bytes} [Tue Apr 26 14:10:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:09.876249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff78ba-13a4-425f-9c49-3f7d6bf3bd73 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:09.892233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff78ba-13a4-425f-9c49-3f7d6bf3bd73 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:09.900612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3451a08-21f5-4856-b22a-01da286b1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:09.901302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a08-21f5-4856-b22a-01da286b1029 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:09.901584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a08-21f5-4856-b22a-01da286b1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:09.901860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3451a08-21f5-4856-b22a-01da286b1029 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:09.902832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a08-21f5-4856-b22a-01da286b1029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:09.904633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3451a08-21f5-4856-b22a-01da286b1029 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:09.997032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 804/1623] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:09.998286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.020716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 820/1624] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:09 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:10.028826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.029804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.030126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.076352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:10.078289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:10.131039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0e977-eaf3-48e4-8384-02b8e82bcd7d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.137784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.138891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.139393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.139973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.172347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 821/1625] 10.222.0.23 () {58 vars in 1056 bytes} [Tue Apr 26 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:10.173500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.209814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.211757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.225906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 805/1626] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:10.226719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.265963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d49a5-16d0-4198-9c93-0d154fe96fe3 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.271424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.272189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.272562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.272907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.273738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.276035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.314571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abeb259-3f31-4c6b-b50c-e21a69eb30f7 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.320992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.321679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.321959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.322255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.323502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.325253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.341220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 806/1627] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:10.341639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.356442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48b3f2-4117-4db2-b311-f4a7aa8ed912 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.364706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.365617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.365930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.366582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.374400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 822/1628] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:10 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:10.376333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.397323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38479801-2d95-4f8e-805f-ee153ccf9d21 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.411685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.413331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.413848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.414374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] PATH_INFO: `/v3/projects/b86927c0bd534d0b8a9e237349b45bfd/users/4ac170c22e2a43b6b080d3510803eb49/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.445329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86927c0bd534d0b8a9e237349b45bfd, user_id=4ac170c22e2a43b6b080d3510803eb49, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.448586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.475085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.477259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.507377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 807/1629] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:10.508788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.524560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77658775-d589-46bb-b605-c8379e049cc6 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.530780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.532132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.532418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.532695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.534542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.540733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.549610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 823/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:10 2022] PUT /identity/v3/projects/b86927c0bd534d0b8a9e237349b45bfd/users/4ac170c22e2a43b6b080d3510803eb49/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:10.550843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.573471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 808/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:10.575455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.587088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42df2d-e98e-4b2b-a203-30f2168576de admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.691815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c00058-c40e-49f4-ad82-00ad1bd07ea1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.708623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.710897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.716054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.716054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.716054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.716054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.716570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621d79-93ac-4e2d-8948-394d289637ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.718595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621d79-93ac-4e2d-8948-394d289637ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.718900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621d79-93ac-4e2d-8948-394d289637ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.720430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621d79-93ac-4e2d-8948-394d289637ac admin admin] PATH_INFO: `/v3/projects/a1b6ddcc3c834ec79482b17f2a2860c1/users/b877ebebdf9b45f8ae77ffd101a9266b/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.752999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 824/1632] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:10.757427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.767237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621d79-93ac-4e2d-8948-394d289637ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b6ddcc3c834ec79482b17f2a2860c1, user_id=b877ebebdf9b45f8ae77ffd101a9266b, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.773909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621d79-93ac-4e2d-8948-394d289637ac admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.778702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560854dd-1a19-4c12-8fda-c04d67bc4d1e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:10.787152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e97ef-1494-4dd7-b576-be692d92a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:10.788410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e97ef-1494-4dd7-b576-be692d92a035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.788803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e97ef-1494-4dd7-b576-be692d92a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.789151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e97ef-1494-4dd7-b576-be692d92a035 admin admin] PATH_INFO: `/v3/projects/b86927c0bd534d0b8a9e237349b45bfd/users/4ac170c22e2a43b6b080d3510803eb49/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.792141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e97ef-1494-4dd7-b576-be692d92a035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86927c0bd534d0b8a9e237349b45bfd, user_id=4ac170c22e2a43b6b080d3510803eb49, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:10.795314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e97ef-1494-4dd7-b576-be692d92a035 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:10.820928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 825/1633] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:10 2022] PUT /identity/v3/projects/b86927c0bd534d0b8a9e237349b45bfd/users/4ac170c22e2a43b6b080d3510803eb49/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:10.824601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216251-9378-4771-8115-d89ea6aeedeb None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.824601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216251-9378-4771-8115-d89ea6aeedeb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.824897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b216251-9378-4771-8115-d89ea6aeedeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.880180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 809/1634] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:10 2022] PUT /identity/v3/projects/a1b6ddcc3c834ec79482b17f2a2860c1/users/b877ebebdf9b45f8ae77ffd101a9266b/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:10.881790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719917b-5a5a-455a-9339-e77842854350 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:10.881922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719917b-5a5a-455a-9339-e77842854350 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:10.882323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719917b-5a5a-455a-9339-e77842854350 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:10.886172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 810/1635] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 26 14:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:10.887114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719917b-5a5a-455a-9339-e77842854350 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:10.892698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0b216251-9378-4771-8115-d89ea6aeedeb None None] MFA Rules not processed for user `4ac170c22e2a43b6b080d3510803eb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:10.896897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0b216251-9378-4771-8115-d89ea6aeedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:11.024553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719917b-5a5a-455a-9339-e77842854350 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:11.038861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88f627-99bb-4b2e-bcc2-11715ec588d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:11.039555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f627-99bb-4b2e-bcc2-11715ec588d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.039832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f627-99bb-4b2e-bcc2-11715ec588d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.040103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88f627-99bb-4b2e-bcc2-11715ec588d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.042824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88f627-99bb-4b2e-bcc2-11715ec588d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:11.047510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88f627-99bb-4b2e-bcc2-11715ec588d6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:11.063886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 826/1636] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:11.065737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716251b6-df53-4175-a77a-c3807de9770b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.067063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716251b6-df53-4175-a77a-c3807de9770b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.070748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716251b6-df53-4175-a77a-c3807de9770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.072491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 811/1637] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:11.074883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0dae-800d-420d-bc8a-5ffa7936614d None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.075419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0dae-800d-420d-bc8a-5ffa7936614d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.075917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0dae-800d-420d-bc8a-5ffa7936614d None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.078524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 812/1638] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 26 14:10:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:11.084797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0dae-800d-420d-bc8a-5ffa7936614d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:11.090217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-716251b6-df53-4175-a77a-c3807de9770b None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:11.091447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-716251b6-df53-4175-a77a-c3807de9770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:11.171210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0dae-800d-420d-bc8a-5ffa7936614d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:11.182739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3786fff-0b87-4386-bed8-3da04c248105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:11.183481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786fff-0b87-4386-bed8-3da04c248105 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.185520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786fff-0b87-4386-bed8-3da04c248105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.185520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786fff-0b87-4386-bed8-3da04c248105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.194852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 827/1639] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:11.196007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716251b6-df53-4175-a77a-c3807de9770b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:11.219619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716251b6-df53-4175-a77a-c3807de9770b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:11.220331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3786fff-0b87-4386-bed8-3da04c248105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:11.222075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3786fff-0b87-4386-bed8-3da04c248105 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:11.226062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:11.226931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.227280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.227624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] PATH_INFO: `/v3/projects/a1b6ddcc3c834ec79482b17f2a2860c1/users/b877ebebdf9b45f8ae77ffd101a9266b/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.230456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b6ddcc3c834ec79482b17f2a2860c1, user_id=b877ebebdf9b45f8ae77ffd101a9266b, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:11.236344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:11.241455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 813/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:11.243145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f3ff-45e8-4d2c-91e1-1b8bab2ba782 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.243650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f3ff-45e8-4d2c-91e1-1b8bab2ba782 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.244162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f3ff-45e8-4d2c-91e1-1b8bab2ba782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.277667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1a81f3ff-45e8-4d2c-91e1-1b8bab2ba782 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:11.279319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1a81f3ff-45e8-4d2c-91e1-1b8bab2ba782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:11.279454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 828/1641] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:11 2022] PUT /identity/v3/projects/a1b6ddcc3c834ec79482b17f2a2860c1/users/b877ebebdf9b45f8ae77ffd101a9266b/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:11.280855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:11.396406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce569b-c6c8-459c-a404-f299574e7777 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:11.408656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:11.410767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.410767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.411280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.421233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 814/1642] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:11.422951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.423586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.423949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.441441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:11.441441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:11.476773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 829/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:11.481134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:11.497951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7059706-109f-4467-b4a7-a60233ab9291 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:11.509447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4747d1-cbf5-4616-a28c-fa3d29535359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:11.510148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4747d1-cbf5-4616-a28c-fa3d29535359 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.510435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4747d1-cbf5-4616-a28c-fa3d29535359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.510707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4747d1-cbf5-4616-a28c-fa3d29535359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.515002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] MFA Rules not processed for user `b877ebebdf9b45f8ae77ffd101a9266b`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:11.516357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:11.532595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4747d1-cbf5-4616-a28c-fa3d29535359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:11.534062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4747d1-cbf5-4616-a28c-fa3d29535359 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:11.576857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 830/1644] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:11.657394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 815/1645] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:11.696295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ba86-90d3-4ea4-a310-d74e1f69ff50 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.696832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ba86-90d3-4ea4-a310-d74e1f69ff50 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.697260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3ba86-90d3-4ea4-a310-d74e1f69ff50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.747507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-f6b3ba86-90d3-4ea4-a310-d74e1f69ff50 None None] MFA Rules not processed for user `6c8c139c181344259612105edd7d207d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:11.747507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f6b3ba86-90d3-4ea4-a310-d74e1f69ff50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:11.819044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:11.833368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1faa41-098a-46ad-beb5-5efa597aa05f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:11.840739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:11.841395 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.841894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.843203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.858848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:11.860555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:11.894554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 831/1646] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:11.895054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 816/1647] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:11.899297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:11.899592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:11.899872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:11.923587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] MFA Rules not processed for user `6c8c139c181344259612105edd7d207d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:11.926233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:11.936074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 832/1648] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:12.224323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:12.226202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:12.245152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375bcbd-92c1-4186-bdea-10d00a1a8d0d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:12.263926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:12.264516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:12.264800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:12.265074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:12.286518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:12.288554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:12.324171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 833/1649] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:12.325147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:12.343949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6df40-f5f3-4a8f-9930-2c874daa1366 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:12.351338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf211c9e-de8a-4c7f-9730-7d8f07473f05 service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:12.355075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:12.355466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89c0d9-c1b4-42b4-95b0-3a437642b6f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:12.355981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:12.356268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:12.356392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c0d9-c1b4-42b4-95b0-3a437642b6f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:12.356607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] PATH_INFO: `/v3/users/e609efce00e144819693d7e290906594` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:12.356850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c0d9-c1b4-42b4-95b0-3a437642b6f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:12.357222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89c0d9-c1b4-42b4-95b0-3a437642b6f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:12.359095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e609efce00e144819693d7e290906594)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:12.363978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:12.589291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c0d9-c1b4-42b4-95b0-3a437642b6f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:12.589291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89c0d9-c1b4-42b4-95b0-3a437642b6f0 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:12.589291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 834/1650] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:12.701652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e609efce00e144819693d7e290906594'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:12.720326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e609efce00e144819693d7e290906594'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:12.721257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e609efce00e144819693d7e290906594'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:12.739230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e609efce00e144819693d7e290906594'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:12.740285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e609efce00e144819693d7e290906594'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:12.843110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 817/1651] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:12 2022] DELETE /identity/v3/users/e609efce00e144819693d7e290906594 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:12.845202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa325-fe88-43c1-a9d7-6b90f1c24fed None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:12.845202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa325-fe88-43c1-a9d7-6b90f1c24fed None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:12.845538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aa325-fe88-43c1-a9d7-6b90f1c24fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:12.884531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fa5aa325-fe88-43c1-a9d7-6b90f1c24fed None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:12.885786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fa5aa325-fe88-43c1-a9d7-6b90f1c24fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:13.038285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 835/1652] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:13.060545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:13.062348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:13.125494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.125958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.126365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.188009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] MFA Rules not processed for user `fc7642ec7a7b475db89a7ff5c98e7e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:13.190094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:13.236434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809f69-6f4e-444d-993d-0afb7caa3ad1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:13.247092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1029641-f73d-476e-8c5d-8a1351059a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:13.247758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029641-f73d-476e-8c5d-8a1351059a09 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.248039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029641-f73d-476e-8c5d-8a1351059a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.248311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1029641-f73d-476e-8c5d-8a1351059a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.276125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029641-f73d-476e-8c5d-8a1351059a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:13.276125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1029641-f73d-476e-8c5d-8a1351059a09 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:13.295671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 818/1653] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:13.302193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89cd98-798f-408c-b008-43b2f6994e55 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.302193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89cd98-798f-408c-b008-43b2f6994e55 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.302193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89cd98-798f-408c-b008-43b2f6994e55 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.302193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 819/1654] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 26 14:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:13.309897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.309897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.310163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.388231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:13.389896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:13.415554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 836/1655] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:13.421056 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:13.422671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:13.423988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 820/1656] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:10:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:13.469653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b8429-40d1-4d24-84be-67168324ec33 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:13.484971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:13.486809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.488465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.488465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.489517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:13.518208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:13.522343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:13.528762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:13.551671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe393b-ed5f-40e4-ad29-b629296ce333 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:13.556724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:13.556724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.557010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.557384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.568796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:13.570855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:13.582457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 821/1657] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:10:13.677225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 837/1658] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:13 2022] POST /identity/v3/projects => generated 405 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:13.681273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:13.697287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079a980-1e2f-42d4-9190-79eeb2cb0da8 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:13.838933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:13.841096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:13.845547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:13.845547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:13.845547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:13.845547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.070385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 822/1659] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:13 2022] POST /identity/v3/users => generated 309 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:14.074895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.088537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e8f27-f7a0-4ee4-9132-37119a5782f7 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:14.107119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:14.107822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.108112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.108391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.109145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:14.110842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.135113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 838/1660] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:14.138597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.163321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d015f2-8c60-4a4a-ba3c-570e49fda002 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:14.175613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:14.176540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.176831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.177110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] PATH_INFO: `/v3/projects/7ebc588f80bc437793b692f62653f259/users/cdfe561853004a9d888ff6cf0762e411/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.192569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.194645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:14.228793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adf131-ef9d-4514-af96-54dc5d66ace8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:14.234476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc588f80bc437793b692f62653f259, user_id=cdfe561853004a9d888ff6cf0762e411, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:14.241893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.248940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:14.250312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.250873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.251303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] PATH_INFO: `/v3/users/69cfdea1b3024bfeaac538fc26601877` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.252995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cfdea1b3024bfeaac538fc26601877)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:14.254816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: WARNING py.warnings [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:10:14.254816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: warnings.warn(msg) Apr 26 14:10:14.254816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: Apr 26 14:10:14.256511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.379978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 823/1661] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:14 2022] PUT /identity/v3/projects/7ebc588f80bc437793b692f62653f259/users/cdfe561853004a9d888ff6cf0762e411/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:14.382220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.514770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cfdea1b3024bfeaac538fc26601877'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:14.516542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cfdea1b3024bfeaac538fc26601877'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:14.517440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cfdea1b3024bfeaac538fc26601877'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:14.533757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1bd3-6941-4eee-b0b3-64484e4b9faf admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:14.545102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e62618-c547-48c3-b98a-c3cbdd23ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:14.546246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62618-c547-48c3-b98a-c3cbdd23ce62 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.546715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62618-c547-48c3-b98a-c3cbdd23ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.547171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62618-c547-48c3-b98a-c3cbdd23ce62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.548076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e62618-c547-48c3-b98a-c3cbdd23ce62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:14.551912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e62618-c547-48c3-b98a-c3cbdd23ce62 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.568209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 824/1662] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:14.568209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb1f7-a646-41f2-8dce-b28e0c254818 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.568209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb1f7-a646-41f2-8dce-b28e0c254818 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.568209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adb1f7-a646-41f2-8dce-b28e0c254818 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.572738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 825/1663] 10.222.0.23 () {54 vars in 960 bytes} [Tue Apr 26 14:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:14.573516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adb1f7-a646-41f2-8dce-b28e0c254818 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.575873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-21adb1f7-a646-41f2-8dce-b28e0c254818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:14.589111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cfdea1b3024bfeaac538fc26601877'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:14.610587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d511ac8d-03f4-4d2a-89aa-2b0081a4b9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cfdea1b3024bfeaac538fc26601877'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:14.620729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adb1f7-a646-41f2-8dce-b28e0c254818 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:14.631945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c9abd-0068-4b82-bf23-8dabe9e957d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:14.633901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9abd-0068-4b82-bf23-8dabe9e957d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.634394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9abd-0068-4b82-bf23-8dabe9e957d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.637751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c9abd-0068-4b82-bf23-8dabe9e957d9 admin admin] PATH_INFO: `/v3/projects/7ebc588f80bc437793b692f62653f259/users/cdfe561853004a9d888ff6cf0762e411/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.645752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c9abd-0068-4b82-bf23-8dabe9e957d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc588f80bc437793b692f62653f259, user_id=cdfe561853004a9d888ff6cf0762e411, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:14.649578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c9abd-0068-4b82-bf23-8dabe9e957d9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.664666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 826/1664] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:14 2022] PUT /identity/v3/projects/7ebc588f80bc437793b692f62653f259/users/cdfe561853004a9d888ff6cf0762e411/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:14.668312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.668607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.668885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.706174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] MFA Rules not processed for user `952f39b205c74255a2776e7fec3b8643`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:14.707467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:14.707875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 839/1665] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:14 2022] DELETE /identity/v3/users/69cfdea1b3024bfeaac538fc26601877 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:14.712935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.713403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.713847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.751051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:14.752310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:14.826260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 827/1666] 10.222.0.23 () {58 vars in 1057 bytes} [Tue Apr 26 14:10:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:14.834731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.857271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5632b0-b5c9-4862-a244-235bc4492b5d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:14.867711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952f39b205c74255a2776e7fec3b8643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:14.868658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:14.869023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:14.869396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:14.871977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:14.887294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 840/1667] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:14.889475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:14.892127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:14.903804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:14.906152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:14.906493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 828/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:15.043161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acee5b-6990-4345-a23c-8fca07cb7eb5 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:15.048471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1e5e0-16b4-42fe-b7d2-9e27a192fcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:15.068250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e5e0-16b4-42fe-b7d2-9e27a192fcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:15.068250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e5e0-16b4-42fe-b7d2-9e27a192fcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:15.068250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1e5e0-16b4-42fe-b7d2-9e27a192fcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:15.084297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1e5e0-16b4-42fe-b7d2-9e27a192fcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:15.085936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1e5e0-16b4-42fe-b7d2-9e27a192fcc4 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:15.099061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 841/1669] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:15.176911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:15.178761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:15.208089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6db9d-61f6-4009-90cf-7c108e7db1b1 service placement] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:15.428951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:15.428951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:15.428951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:15.428951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] PATH_INFO: `/v3/projects/8b1983791ecd4f19a49b3aace13524ea` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:15.440239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1983791ecd4f19a49b3aace13524ea)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:15.440239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: WARNING py.warnings [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:10:15.440239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: warnings.warn(msg) Apr 26 14:10:15.440239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: Apr 26 14:10:15.440239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:15.479103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1983791ecd4f19a49b3aace13524ea', 'request_id': 'req-1a4291cf-c541-4e79-9a95-136a39b64b5e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:15.494846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1983791ecd4f19a49b3aace13524ea', 'request_id': 'req-1a4291cf-c541-4e79-9a95-136a39b64b5e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:15.528461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1983791ecd4f19a49b3aace13524ea', 'request_id': 'req-1a4291cf-c541-4e79-9a95-136a39b64b5e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:15.618247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] The token cache is being invalidate because project 8b1983791ecd4f19a49b3aace13524ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:15.618541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:15.620947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1a4291cf-c541-4e79-9a95-136a39b64b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:15.621720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 829/1670] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:15 2022] DELETE /identity/v3/projects/8b1983791ecd4f19a49b3aace13524ea => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:15.627711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:15.628318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:15.628886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:15.697127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:15.700173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:15.883725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 842/1671] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:15.891671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:15.892102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:15.892235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:15.966350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:15.973909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:15.999536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 830/1672] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:16.004767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:16.020989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325d940-03cc-4ed8-9a5c-be6051e30ac4 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:16.026847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:16.027528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.027821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.028104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.028909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:16.029223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:16.031156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:16.057840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 843/1673] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:16.059506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:16.076975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f345-b875-49eb-912e-dde4f4af643d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:16.087782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:16.089543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.089840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.090163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.090887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:16.097853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:16.233950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 831/1674] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:16 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:16.237139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:16.262199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc86f43-b3e3-4c00-85eb-a39df781afa3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:16.479957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:16.481221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.481221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.481221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.481949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:16.495752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:16.616279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 844/1675] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:16 2022] POST /identity/v3/users => generated 294 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:16.620827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:16.637958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf904-2f83-4247-b0c1-18617b797987 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:16.655615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:16.656612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.657049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.657477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.658417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:16.660340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:16.689695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 832/1676] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:16.693905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:16.704768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a5d55-81d9-401d-b0d1-034d2308530e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:16.722362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf05226-ab79-4b38-9574-7c0586960aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:16.723189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05226-ab79-4b38-9574-7c0586960aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.723583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05226-ab79-4b38-9574-7c0586960aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.723978 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf05226-ab79-4b38-9574-7c0586960aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.725446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf05226-ab79-4b38-9574-7c0586960aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:16.727213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf05226-ab79-4b38-9574-7c0586960aa2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:16.750977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:16.761284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98ed99-b008-4c3d-88a5-2386cd3de932 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:16.764161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 845/1677] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:16.776548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:16.777700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.778205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.778661 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] PATH_INFO: `/v3/projects/836e6c0b48cf406c92e7819c05d8172a/users/06505f0061094365a9ac4b17248bfa14/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.794594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836e6c0b48cf406c92e7819c05d8172a, user_id=06505f0061094365a9ac4b17248bfa14, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:16.798072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:16.885304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 833/1678] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:16 2022] PUT /identity/v3/projects/836e6c0b48cf406c92e7819c05d8172a/users/06505f0061094365a9ac4b17248bfa14/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:16.897578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:16.898071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:16.898376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:16.957853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] MFA Rules not processed for user `06505f0061094365a9ac4b17248bfa14`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:16.963274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:17.106161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 846/1679] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:17.114825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:17.120455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:17.125738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:17.255006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a685d-44b6-4da5-8847-bec185eaa626 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:17.264025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:17.265101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:17.265559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:17.266031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] PATH_INFO: `/v3/users/ed757ee391d647fdbd6d3d10798da228` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:17.268099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed757ee391d647fdbd6d3d10798da228)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:17.270604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:17.278413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa09e-d060-4ade-aebf-268077ba24c6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:17.290626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:17.291679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:17.291957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:17.292234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:17.292934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:17.297307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:17.451848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 834/1680] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:17 2022] POST /identity/v3/projects => generated 387 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:17.452958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:17.457481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:17.543187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed757ee391d647fdbd6d3d10798da228'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.545711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed757ee391d647fdbd6d3d10798da228'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.547493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed757ee391d647fdbd6d3d10798da228'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.590850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa564268-57d0-4932-bc5c-a545da3dc100 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:17.596384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:17.597595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:17.597943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:17.598249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] PATH_INFO: `/v3/projects/92219fbf5acf4734907d95d02b678872` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:17.601073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] RBAC: Authorizing `identity:delete_project(project_id=92219fbf5acf4734907d95d02b678872)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:17.606388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:17.634184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed757ee391d647fdbd6d3d10798da228'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.644395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed757ee391d647fdbd6d3d10798da228'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.678549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 847/1681] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:17 2022] DELETE /identity/v3/users/ed757ee391d647fdbd6d3d10798da228 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:17.680087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:17.681829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:17.817929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da4a13-966d-4185-8341-98861225f38e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:17.833200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b458dc4-e1bd-47eb-97ad-9bd363b169fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:17.839981 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458dc4-e1bd-47eb-97ad-9bd363b169fc admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:17.840600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458dc4-e1bd-47eb-97ad-9bd363b169fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:17.841257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b458dc4-e1bd-47eb-97ad-9bd363b169fc admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:17.842252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458dc4-e1bd-47eb-97ad-9bd363b169fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:17.847825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b458dc4-e1bd-47eb-97ad-9bd363b169fc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:17.854555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92219fbf5acf4734907d95d02b678872', 'request_id': 'req-2273a240-1536-422a-b4e0-be194f2b793b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.874183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92219fbf5acf4734907d95d02b678872', 'request_id': 'req-2273a240-1536-422a-b4e0-be194f2b793b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.912082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92219fbf5acf4734907d95d02b678872', 'request_id': 'req-2273a240-1536-422a-b4e0-be194f2b793b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:17.966599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 848/1682] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:17 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:17.968932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:17.969497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:17.969999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:18.035939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:18.038948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:18.045318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] The token cache is being invalidate because project 92219fbf5acf4734907d95d02b678872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:18.045832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.050603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.053811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 835/1683] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:17 2022] DELETE /identity/v3/projects/92219fbf5acf4734907d95d02b678872 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:18.057844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:18.062690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:18.248305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 849/1684] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:18.249959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:18.256173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:18.280570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95eec0-ace0-457f-a7b3-8663cfe4cb06 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:18.287025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:18.288514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:18.289188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:18.289545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] PATH_INFO: `/v3/users/4ac170c22e2a43b6b080d3510803eb49` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:18.291044 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac170c22e2a43b6b080d3510803eb49)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:18.294126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:18.317377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a240-1536-422a-b4e0-be194f2b793b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:18.335473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:18.336172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:18.336458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:18.336733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:18.341143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:18.341143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:18.375883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 836/1685] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:18.375883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:18.375883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:18.488489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736466c0-a0ad-4ef4-bb9c-def05f2ca44a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:18.498758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:18.498911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:18.499109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:18.499478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:18.522309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:18.523788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:18.558376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac170c22e2a43b6b080d3510803eb49'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.561597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac170c22e2a43b6b080d3510803eb49'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.565400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 837/1686] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:18.567234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac170c22e2a43b6b080d3510803eb49'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.568321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:18.579534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc10adf-0f13-4fc8-bea1-d6f01bc71ede service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:18.585295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:18.586437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:18.586894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:18.587360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] PATH_INFO: `/v3/projects/b50db73a3f194dffb93e2e93800d5cea/users/9d823f9a02ff4d899ee0dcc24234b53f/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:18.605463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50db73a3f194dffb93e2e93800d5cea, user_id=9d823f9a02ff4d899ee0dcc24234b53f, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:18.608879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:18.685662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac170c22e2a43b6b080d3510803eb49'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.705276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac170c22e2a43b6b080d3510803eb49'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:18.722373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 838/1687] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:18 2022] PUT /identity/v3/projects/b50db73a3f194dffb93e2e93800d5cea/users/9d823f9a02ff4d899ee0dcc24234b53f/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:18.727415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:18.729583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 850/1688] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:18 2022] DELETE /identity/v3/users/4ac170c22e2a43b6b080d3510803eb49 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:18.730204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:18.859734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc9403-c95e-4d00-ab07-18993f2ec84e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:18.949772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a07793-59a7-45ef-baf1-0b15f2bda02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:18.950792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a07793-59a7-45ef-baf1-0b15f2bda02b admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:18.951145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a07793-59a7-45ef-baf1-0b15f2bda02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:18.951599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a07793-59a7-45ef-baf1-0b15f2bda02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:18.952708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a07793-59a7-45ef-baf1-0b15f2bda02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:18.954434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a07793-59a7-45ef-baf1-0b15f2bda02b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:18.969611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:18.970217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 839/1689] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:18.980504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72198f20-6ea2-4fdd-9c7f-b35e2c350774 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:18.996707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:18.997001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:18.997333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.010090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9f57d-c9be-46a8-a308-9865fc4330c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:19.013645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f57d-c9be-46a8-a308-9865fc4330c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.013938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f57d-c9be-46a8-a308-9865fc4330c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.018369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9f57d-c9be-46a8-a308-9865fc4330c2 admin admin] PATH_INFO: `/v3/projects/b50db73a3f194dffb93e2e93800d5cea/users/9d823f9a02ff4d899ee0dcc24234b53f/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.023697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f57d-c9be-46a8-a308-9865fc4330c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50db73a3f194dffb93e2e93800d5cea, user_id=9d823f9a02ff4d899ee0dcc24234b53f, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:19.029132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9f57d-c9be-46a8-a308-9865fc4330c2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:19.036206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] MFA Rules not processed for user `cdfe561853004a9d888ff6cf0762e411`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:19.037418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:19.083434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 851/1690] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:18 2022] PUT /identity/v3/projects/b50db73a3f194dffb93e2e93800d5cea/users/9d823f9a02ff4d899ee0dcc24234b53f/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:19.096058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.113768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.113768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.171876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] MFA Rules not processed for user `9d823f9a02ff4d899ee0dcc24234b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:19.175597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:19.219659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 840/1691] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:19.241161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:19.242713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:19.276668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38520f19-9e71-4e28-8aa2-f8fecb2ba53b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:19.357994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 852/1692] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:19.369955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:19.371571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:19.372442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:19.373547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.373899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.374275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] PATH_INFO: `/v3/users/5ab6476355fc4589b7554d5cb53b0b75` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.375587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab6476355fc4589b7554d5cb53b0b75)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:19.378586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:19.480455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2e9d-1fca-41fb-b3ee-0fbcd120630f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:19.485584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:19.486542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.486932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.488278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.508667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:19.510547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:19.529896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 853/1693] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:10:19.604240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab6476355fc4589b7554d5cb53b0b75'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:19.632842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab6476355fc4589b7554d5cb53b0b75'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:19.633658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab6476355fc4589b7554d5cb53b0b75'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:19.643395 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab6476355fc4589b7554d5cb53b0b75'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:19.646307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cf279ba3-b6d7-4c0d-a674-f2cff33915d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab6476355fc4589b7554d5cb53b0b75'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:19.703878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:19.724379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390ffbb-934b-44d3-b404-c545514b9590 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:19.726863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 841/1694] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:19 2022] DELETE /identity/v3/users/5ab6476355fc4589b7554d5cb53b0b75 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:19.731847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e85da-53e7-42ca-bc4b-751b7856452d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.733903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e85da-53e7-42ca-bc4b-751b7856452d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.735552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e85da-53e7-42ca-bc4b-751b7856452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.798817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a50e85da-53e7-42ca-bc4b-751b7856452d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:19.800606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a50e85da-53e7-42ca-bc4b-751b7856452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:19.843291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:19.845265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.845670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.846098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] PATH_INFO: `/v3/users/06505f0061094365a9ac4b17248bfa14` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:19.847621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06505f0061094365a9ac4b17248bfa14)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:19.850974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:19.978209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 842/1695] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:19.988281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:19.988783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:19.989253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.013472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:20.015498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.024045 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06505f0061094365a9ac4b17248bfa14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.029461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06505f0061094365a9ac4b17248bfa14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.029461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06505f0061094365a9ac4b17248bfa14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.096659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06505f0061094365a9ac4b17248bfa14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.106607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 843/1696] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:10:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:20.107881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:20.109469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.109797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f8bfa4c6-c6df-4079-9be7-0019d09dfa13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06505f0061094365a9ac4b17248bfa14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.149613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 854/1697] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:19 2022] DELETE /identity/v3/users/06505f0061094365a9ac4b17248bfa14 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:20.154295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.154868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.158628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.189252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d96ac6-89d9-4b32-8258-6591a276531e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:20.194528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:20.196070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.255350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:20.256413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.256762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.257134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.259912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.324315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 855/1698] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:20.324315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:20.326353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.347506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba244a-52a5-44dc-bf60-7dbd8d8b3e1e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:20.359786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:20.360977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.361453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.361740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] PATH_INFO: `/v3/projects/f655c8d396cb4e56955bc6a3be6e69c1` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.363897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f655c8d396cb4e56955bc6a3be6e69c1)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:20.364846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:20.365849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:20.366946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:20.380753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 844/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:20.387871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:20.401855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3d997-a6df-4763-9daf-942333149178 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:20.407321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7f10-9c5e-464a-a233-1dffa84f3891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:20.408388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7f10-9c5e-464a-a233-1dffa84f3891 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.408711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7f10-9c5e-464a-a233-1dffa84f3891 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.409111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7f10-9c5e-464a-a233-1dffa84f3891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.424016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f7f10-9c5e-464a-a233-1dffa84f3891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:20.426972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f7f10-9c5e-464a-a233-1dffa84f3891 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:20.446059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 845/1700] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:20.447509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.447769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.448803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.488459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] MFA Rules not processed for user `706ce393383a460b9b5857f74224a1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:20.489893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.503620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f655c8d396cb4e56955bc6a3be6e69c1', 'request_id': 'req-bbbcc633-5f0e-465b-99cb-1b0be4324197'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.576036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f655c8d396cb4e56955bc6a3be6e69c1', 'request_id': 'req-bbbcc633-5f0e-465b-99cb-1b0be4324197'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.583985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f655c8d396cb4e56955bc6a3be6e69c1', 'request_id': 'req-bbbcc633-5f0e-465b-99cb-1b0be4324197'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.602865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] The token cache is being invalidate because project f655c8d396cb4e56955bc6a3be6e69c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:20.604580 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.610367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.613451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 856/1701] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:20 2022] DELETE /identity/v3/projects/f655c8d396cb4e56955bc6a3be6e69c1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:20.614608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:20.617137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 846/1702] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:20.618349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:20.623727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.626849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.718698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcc633-5f0e-465b-99cb-1b0be4324197 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:20.724308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:20.725425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.725887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.726346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] PATH_INFO: `/v3/projects/b86927c0bd534d0b8a9e237349b45bfd` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.727747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86927c0bd534d0b8a9e237349b45bfd)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:20.730042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:20.752541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d993b-692c-4110-9eb6-6f5443ad0d01 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:20.763819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:20.764554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.764996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.765280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.767572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.873535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:20.876977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f295fc0-ec8d-4c87-9ad5-f62f49b6d0b5 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:20.895576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 847/1703] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:10:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:10:20.896186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86927c0bd534d0b8a9e237349b45bfd', 'request_id': 'req-ae7f0558-5e61-47f2-b39a-83b0c3492393'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.900773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f0433-bdfa-4973-93c1-6b27f13d9fc8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:20.901218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f0433-bdfa-4973-93c1-6b27f13d9fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:20.901586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f0433-bdfa-4973-93c1-6b27f13d9fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:20.929071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3a9f0433-bdfa-4973-93c1-6b27f13d9fc8 None None] MFA Rules not processed for user `706ce393383a460b9b5857f74224a1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:20.930510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3a9f0433-bdfa-4973-93c1-6b27f13d9fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:20.981876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86927c0bd534d0b8a9e237349b45bfd', 'request_id': 'req-ae7f0558-5e61-47f2-b39a-83b0c3492393'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:20.989204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86927c0bd534d0b8a9e237349b45bfd', 'request_id': 'req-ae7f0558-5e61-47f2-b39a-83b0c3492393'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:21.027301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] The token cache is being invalidate because project b86927c0bd534d0b8a9e237349b45bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:21.028041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:21.028841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ae7f0558-5e61-47f2-b39a-83b0c3492393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:21.038365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 857/1704] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:20 2022] DELETE /identity/v3/projects/b86927c0bd534d0b8a9e237349b45bfd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:21.040204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.046550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.046550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.069842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 848/1705] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:21.071265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a511-c168-4660-9094-e01b274480e4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.071557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a511-c168-4660-9094-e01b274480e4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.071835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9a511-c168-4660-9094-e01b274480e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.084482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:21.087639 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:21.135284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ece9a511-c168-4660-9094-e01b274480e4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:21.136792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ece9a511-c168-4660-9094-e01b274480e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:21.260006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 858/1706] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:21.260962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.262435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:21.298647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 849/1707] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:21.310883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224db8-f6b1-4335-8045-c45849b00fa4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.311177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224db8-f6b1-4335-8045-c45849b00fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.315195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224db8-f6b1-4335-8045-c45849b00fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.336496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-95224db8-f6b1-4335-8045-c45849b00fa4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:21.337957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-95224db8-f6b1-4335-8045-c45849b00fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:21.356212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 850/1708] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:21.356212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.356212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.356212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.391245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:21.392484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:21.411911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 851/1709] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:21.413465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.429219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120daf1-55dc-4b01-9ae7-9e323b1bb020 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.451152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.452708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.453100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.454314 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.455239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:21.455827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.459780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:21.464454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aed083-0035-44e0-a7be-2a7327b6ed80 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.481112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 852/1710] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:21.481408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.493732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.494916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.495218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.495496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.499239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11036a36-ea08-4a45-81fa-9e2816ec9b6e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.502234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:21.510156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.511190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.511485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.511948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.513034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:21.513338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.515933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:21.537485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.543724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 853/1711] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:21.547110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:21.547860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.584744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f440ec-6555-4264-945c-e497072b08ac admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.594604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 859/1712] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:21.596128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.599846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.600993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.602149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.604383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.605249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.607302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:21.619023 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae66cd6-1c27-4044-b51b-5276a151c28c service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.633122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.633897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.634307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.634647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.635431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.637645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:21.735464 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 854/1713] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:21.742818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.774118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 860/1714] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/projects => generated 357 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:21.775914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:21.917952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff33e2d-f59f-42ca-85ef-9b36a75ae531 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.937198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23074e-a009-4604-8102-7e34edd02a54 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:21.937198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.937198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.937198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.937700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.937700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.937700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:21.937889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:21.937889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:21.937889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:21.937889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:21.938442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:21.938442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.156486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 861/1715] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/users => generated 279 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:22.160712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 855/1716] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:21 2022] POST /identity/v3/users => generated 283 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:22.161918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.162390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.184993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944355b-516e-46fe-9484-1feb9eba8734 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:22.185286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3a77d-0e36-405a-a9ce-056b52eb8f31 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:22.192724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:22.193438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.193728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.194032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.197902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:22.199638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.199981 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:22.200772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.201525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.201861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.202729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:22.205689 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.228492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 856/1717] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:22.232164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 862/1718] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:10:22.235582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.235732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.253769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521026-a534-420b-9738-c26703f80156 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:22.256087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:22.256994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.257601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.258124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.259047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:22.260996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.263179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1bcb-4dbc-4d0d-9d7d-84dd756578be admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:22.274298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 863/1719] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:10:22.278542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.289154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:22.289882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.290165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.290520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.291309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:22.294106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.299193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b21ef-e1ad-40ed-818c-4d9e434a3072 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:22.314638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cb757-56a4-4aa5-9128-e06d07c4b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:22.315134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb757-56a4-4aa5-9128-e06d07c4b4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.324139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb757-56a4-4aa5-9128-e06d07c4b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.324139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb757-56a4-4aa5-9128-e06d07c4b4ac admin admin] PATH_INFO: `/v3/projects/5982c4c40b57402099f23e2d86537f25/users/de56ade133e34443ba7d606eb5958c92/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.324454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 857/1720] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:22.325484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.355875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b574ae7-2a64-4f0a-bb2b-57f9d15611cf admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:22.365847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cb757-56a4-4aa5-9128-e06d07c4b4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5982c4c40b57402099f23e2d86537f25, user_id=de56ade133e34443ba7d606eb5958c92, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:22.366475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0fa59-4bc1-4fcb-97f1-636ea0c39e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:22.367757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0fa59-4bc1-4fcb-97f1-636ea0c39e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.368045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0fa59-4bc1-4fcb-97f1-636ea0c39e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.368325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0fa59-4bc1-4fcb-97f1-636ea0c39e70 admin admin] PATH_INFO: `/v3/projects/449990adef6846e5934ca07f07d34842/users/75fd33c6e67b443eaae5eb01740ad3ef/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.375790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cb757-56a4-4aa5-9128-e06d07c4b4ac admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.396051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0fa59-4bc1-4fcb-97f1-636ea0c39e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449990adef6846e5934ca07f07d34842, user_id=75fd33c6e67b443eaae5eb01740ad3ef, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:22.403376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0fa59-4bc1-4fcb-97f1-636ea0c39e70 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:22.497755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 864/1721] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:22 2022] PUT /identity/v3/projects/5982c4c40b57402099f23e2d86537f25/users/de56ade133e34443ba7d606eb5958c92/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:22.507292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcb03-a724-4ae6-bd34-ebf9fddc283f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.507665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcb03-a724-4ae6-bd34-ebf9fddc283f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.508011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbcb03-a724-4ae6-bd34-ebf9fddc283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.535640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 858/1722] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:22 2022] PUT /identity/v3/projects/449990adef6846e5934ca07f07d34842/users/75fd33c6e67b443eaae5eb01740ad3ef/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:22.537869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.538195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.540239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.578251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-88cbcb03-a724-4ae6-bd34-ebf9fddc283f None None] MFA Rules not processed for user `de56ade133e34443ba7d606eb5958c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:22.580469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-88cbcb03-a724-4ae6-bd34-ebf9fddc283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:22.640369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] MFA Rules not processed for user `75fd33c6e67b443eaae5eb01740ad3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:22.648289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:22.797308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 865/1723] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:22.797308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f559f31-a479-4b7f-90b8-ed024e2e5bb8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:22.797308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f559f31-a479-4b7f-90b8-ed024e2e5bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:22.797308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f559f31-a479-4b7f-90b8-ed024e2e5bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:22.819390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 859/1724] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:22.821743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:22.825818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:22.841676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1f559f31-a479-4b7f-90b8-ed024e2e5bb8 None None] MFA Rules not processed for user `5adf6fccb73242bab32c2fdf0ea23ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:22.843410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1f559f31-a479-4b7f-90b8-ed024e2e5bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:23.009663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5acb9c-a975-4c76-91ca-e0b906ab7542 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:23.017712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:23.020130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:23.020600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:23.021262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] PATH_INFO: `/v3/projects/e7647b2a47a04782aac0cfafc3641f4c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:23.023091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7647b2a47a04782aac0cfafc3641f4c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:23.026768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:23.082528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 866/1725] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:23.085662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107f1a-797a-4eb6-8edb-6681d3c63205 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:23.086217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107f1a-797a-4eb6-8edb-6681d3c63205 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:23.086561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107f1a-797a-4eb6-8edb-6681d3c63205 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:23.088654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 867/1726] 10.222.0.23 () {54 vars in 912 bytes} [Tue Apr 26 14:10:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:23.089794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107f1a-797a-4eb6-8edb-6681d3c63205 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:23.101028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-05107f1a-797a-4eb6-8edb-6681d3c63205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:23.195465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7647b2a47a04782aac0cfafc3641f4c', 'request_id': 'req-293d7425-4cf1-42fe-a52c-280eff7f6bf7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:23.210951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7647b2a47a04782aac0cfafc3641f4c', 'request_id': 'req-293d7425-4cf1-42fe-a52c-280eff7f6bf7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:23.223611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7647b2a47a04782aac0cfafc3641f4c', 'request_id': 'req-293d7425-4cf1-42fe-a52c-280eff7f6bf7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:23.314667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] The token cache is being invalidate because project e7647b2a47a04782aac0cfafc3641f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:23.315024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:23.316441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:23.318806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107f1a-797a-4eb6-8edb-6681d3c63205 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:23.323246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 860/1727] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:22 2022] DELETE /identity/v3/projects/e7647b2a47a04782aac0cfafc3641f4c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:23.325395 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:23.327763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:23.539513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:23.540618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:23.541046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:23.541332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:23.547808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:23.636721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d7425-4cf1-42fe-a52c-280eff7f6bf7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:23.691697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:23.693492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379770d-435b-4553-974f-046feab16a25 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:23.700022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:23.700742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:23.702618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:23.702618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:23.704572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:23.714165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:23.771667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 868/1728] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:23.778494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:23.778494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:23.778494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:23.797095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:23.799156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:23.889455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 861/1729] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:23 2022] POST /identity/v3/projects => generated 357 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:23.894309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:23.898630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:23.944954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 869/1730] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:23.945913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:23.949851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:24.056594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e800b-308d-4744-affd-ff49487674b4 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:24.159717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4dab5-7de4-455a-8e84-0f7eaec5f4b1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:24.165659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:24.166918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:24.167440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:24.167920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:24.170530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:24.179312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:24.180389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:24.180849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:24.181054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] PATH_INFO: `/v3/users/b877ebebdf9b45f8ae77ffd101a9266b` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:24.182762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b877ebebdf9b45f8ae77ffd101a9266b)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:24.185451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:24.295584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:24.297176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:24.322382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 870/1731] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:24.323407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:24.334924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:24.379279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90854dd7-31c0-4f63-b6b1-ea22abbb0fa8 service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:24.390724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:24.392436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:24.392910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:24.393346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] PATH_INFO: `/v3/projects/836e6c0b48cf406c92e7819c05d8172a` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:24.397716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836e6c0b48cf406c92e7819c05d8172a)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:24.400178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:24.506335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b877ebebdf9b45f8ae77ffd101a9266b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.552610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b877ebebdf9b45f8ae77ffd101a9266b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.553658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b877ebebdf9b45f8ae77ffd101a9266b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.569388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b877ebebdf9b45f8ae77ffd101a9266b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.571163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b877ebebdf9b45f8ae77ffd101a9266b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.635016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836e6c0b48cf406c92e7819c05d8172a', 'request_id': 'req-4f2848fa-d042-418b-bd85-b2871cd18d06'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.655500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 862/1732] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:23 2022] DELETE /identity/v3/users/b877ebebdf9b45f8ae77ffd101a9266b => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:24.663408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:24.664970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:24.712998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836e6c0b48cf406c92e7819c05d8172a', 'request_id': 'req-4f2848fa-d042-418b-bd85-b2871cd18d06'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.725623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836e6c0b48cf406c92e7819c05d8172a', 'request_id': 'req-4f2848fa-d042-418b-bd85-b2871cd18d06'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.757591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] The token cache is being invalidate because project 836e6c0b48cf406c92e7819c05d8172a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:24.757888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.763090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:24.770389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 871/1733] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:24 2022] DELETE /identity/v3/projects/836e6c0b48cf406c92e7819c05d8172a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:24.771374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:24.782098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:24.934013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c8a77-6fd4-4270-b83a-100f78c320ba admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:24.968139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2848fa-d042-418b-bd85-b2871cd18d06 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:24.975283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1ee26-4d55-4820-a3bc-89bba0653fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:24.976004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ee26-4d55-4820-a3bc-89bba0653fee admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:24.976295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ee26-4d55-4820-a3bc-89bba0653fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:24.976582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1ee26-4d55-4820-a3bc-89bba0653fee admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:24.977290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ee26-4d55-4820-a3bc-89bba0653fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:24.986669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1ee26-4d55-4820-a3bc-89bba0653fee admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.088601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:25.089332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.089627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.089905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.099042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.116817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:25.116945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 863/1734] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:24 2022] POST /identity/v3/users => generated 285 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:25.118511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.118877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.119215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.119331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.132915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 872/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:25.151164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:25.151164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.154984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:25.157373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.176017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fa5c6-536b-4167-a221-b7f2a7d8cf55 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:25.186535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 864/1736] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Apr 26 14:10:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:25.187548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:25.188693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:25.188918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.189588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.189875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.190166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] PATH_INFO: `/v3/users/9d823f9a02ff4d899ee0dcc24234b53f` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.192579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d823f9a02ff4d899ee0dcc24234b53f)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:25.199391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.228673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c703cd94-cd47-4297-a6f9-13fecb2c9277 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:25.235386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:25.236147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.236507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.236854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.238690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:25.241055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.278001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 865/1737] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:25.279212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:25.281329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.303170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b53c52-a29d-4e5f-8e4e-d968ea76b956 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:25.343391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:25.346434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.346849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.347777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.376409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:25.379675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.392066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 866/1738] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:25.394747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:25.420718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d71451-8fb0-4155-b6d9-5629bc3bc11b service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:25.429306 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:25.430964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.431487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.432222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] PATH_INFO: `/v3/projects/74807a98bd504c8288b47f555d46aacd/users/8952acfc7fce4001b038a001fcf434ba/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.438658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d823f9a02ff4d899ee0dcc24234b53f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:25.442260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d823f9a02ff4d899ee0dcc24234b53f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:25.444173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d823f9a02ff4d899ee0dcc24234b53f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:25.458897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] RBAC: Authorizing `identity:create_grant(project_id=74807a98bd504c8288b47f555d46aacd, user_id=8952acfc7fce4001b038a001fcf434ba, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:25.463562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.542986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d823f9a02ff4d899ee0dcc24234b53f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:25.559362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d823f9a02ff4d899ee0dcc24234b53f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:25.618147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 867/1739] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:25 2022] PUT /identity/v3/projects/74807a98bd504c8288b47f555d46aacd/users/8952acfc7fce4001b038a001fcf434ba/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:25.622466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:25.629630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.700069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 873/1740] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:25 2022] DELETE /identity/v3/users/9d823f9a02ff4d899ee0dcc24234b53f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:25.782677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:25.785300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:25.796763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8755b5-906a-41d9-acb6-f434c924292f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:25.956256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:25.956938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:25.957225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:25.957510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:25.958342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:25.962560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:25.995481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 868/1741] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:25.998148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:26.007943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2972757-d860-42ee-a566-b6b912861fbc admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:26.022796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:26.024114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:26.024549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:26.024991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] PATH_INFO: `/v3/users/fc7642ec7a7b475db89a7ff5c98e7e92` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:26.028361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b6309-0cbf-4566-91c7-7b5823463587 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:26.046435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7642ec7a7b475db89a7ff5c98e7e92)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:26.046435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:26.046826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c0b3d-aa61-4185-ae89-80c521d4d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:26.046826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c0b3d-aa61-4185-ae89-80c521d4d2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:26.046826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c0b3d-aa61-4185-ae89-80c521d4d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:26.046826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c0b3d-aa61-4185-ae89-80c521d4d2c4 admin admin] PATH_INFO: `/v3/projects/74807a98bd504c8288b47f555d46aacd/users/8952acfc7fce4001b038a001fcf434ba/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:26.047247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c0b3d-aa61-4185-ae89-80c521d4d2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74807a98bd504c8288b47f555d46aacd, user_id=8952acfc7fce4001b038a001fcf434ba, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:26.061209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c0b3d-aa61-4185-ae89-80c521d4d2c4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:26.109331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 869/1742] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:25 2022] PUT /identity/v3/projects/74807a98bd504c8288b47f555d46aacd/users/8952acfc7fce4001b038a001fcf434ba/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:26.126698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:26.127142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:26.127552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:26.193320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] MFA Rules not processed for user `8952acfc7fce4001b038a001fcf434ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:26.194778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:26.356706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7642ec7a7b475db89a7ff5c98e7e92'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:26.359591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7642ec7a7b475db89a7ff5c98e7e92'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:26.360140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7642ec7a7b475db89a7ff5c98e7e92'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:26.467393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 870/1743] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:26 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:26.479508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7642ec7a7b475db89a7ff5c98e7e92'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:26.494017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:26.496616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:26.497190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5e195126-2f8d-4824-b20c-f4ca397c75e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7642ec7a7b475db89a7ff5c98e7e92'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:26.558533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 874/1744] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:25 2022] DELETE /identity/v3/users/fc7642ec7a7b475db89a7ff5c98e7e92 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:26.636414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67454326-5871-42a6-b6a7-27f68818b9d3 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:26.807199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:26.807199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:26.807199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:26.807199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:27.047114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:27.049516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:27.083593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 871/1745] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:26 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:10:27.182630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:27.186038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:27.186038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:27.232589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] MFA Rules not processed for user `706ce393383a460b9b5857f74224a1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:27.232589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:27.348448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:27.350167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:27.463758 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 875/1746] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:27.467882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:27.505828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfff7e-1ff1-4d17-bd60-9f9a937aaba9 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:27.528632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:27.529633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:27.530883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:27.531306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:27.535982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:27.611823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73098d-dbfc-402a-a279-65ae1154bbb0 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:27.629855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:27.632531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:27.633336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:27.633820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] PATH_INFO: `/v3/projects/b50db73a3f194dffb93e2e93800d5cea` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:27.640993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50db73a3f194dffb93e2e93800d5cea)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:27.650572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:27.789362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:27.791115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:27.848066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 876/1747] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:27 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:27.858856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50db73a3f194dffb93e2e93800d5cea', 'request_id': 'req-c0fffc77-5eac-4111-9bd8-28bf1412edff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:27.880861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50db73a3f194dffb93e2e93800d5cea', 'request_id': 'req-c0fffc77-5eac-4111-9bd8-28bf1412edff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:27.902998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50db73a3f194dffb93e2e93800d5cea', 'request_id': 'req-c0fffc77-5eac-4111-9bd8-28bf1412edff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:27.933050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:27.934999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:27.979716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67349750-c6db-4be4-bb26-0f0ad08f2998 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:28.011629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] The token cache is being invalidate because project b50db73a3f194dffb93e2e93800d5cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:28.015248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.015248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c0fffc77-5eac-4111-9bd8-28bf1412edff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.017248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 872/1748] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:27 2022] DELETE /identity/v3/projects/b50db73a3f194dffb93e2e93800d5cea => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:28.030569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:28.030858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:28.032299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:28.113569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:28.115000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:28.156217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:28.158563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:28.173345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:28.173345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] PATH_INFO: `/v3/projects/3889c033c96540dc97f295d397829779` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:28.173345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3889c033c96540dc97f295d397829779)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:28.174465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:28.310167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 873/1749] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:28.311630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:28.318303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:28.345739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5ebea-e179-49ff-8760-55fcbd766adf None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:28.395490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3889c033c96540dc97f295d397829779', 'request_id': 'req-6b29f9b9-cae4-4b99-ad57-b722698829d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.508228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3889c033c96540dc97f295d397829779', 'request_id': 'req-6b29f9b9-cae4-4b99-ad57-b722698829d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.519096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3889c033c96540dc97f295d397829779', 'request_id': 'req-6b29f9b9-cae4-4b99-ad57-b722698829d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.562418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:28.563736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:28.564879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:28.565878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] PATH_INFO: `/v3/projects/a1b6ddcc3c834ec79482b17f2a2860c1` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:28.571160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b6ddcc3c834ec79482b17f2a2860c1)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:28.573375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:28.608628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] The token cache is being invalidate because project 3889c033c96540dc97f295d397829779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:28.608899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.620552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b29f9b9-cae4-4b99-ad57-b722698829d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.634118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 877/1750] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:27 2022] DELETE /identity/v3/projects/3889c033c96540dc97f295d397829779 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:28.642846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dca53-452b-455c-a2f6-2f02fe7803c6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:28.646818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dca53-452b-455c-a2f6-2f02fe7803c6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:28.648409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dca53-452b-455c-a2f6-2f02fe7803c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:28.820210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ab4dca53-452b-455c-a2f6-2f02fe7803c6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:28.839158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ab4dca53-452b-455c-a2f6-2f02fe7803c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:28.874670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b6ddcc3c834ec79482b17f2a2860c1', 'request_id': 'req-8f2feb54-34e2-4fa1-842c-cd2755f119fb'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.911929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b6ddcc3c834ec79482b17f2a2860c1', 'request_id': 'req-8f2feb54-34e2-4fa1-842c-cd2755f119fb'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:28.932023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b6ddcc3c834ec79482b17f2a2860c1', 'request_id': 'req-8f2feb54-34e2-4fa1-842c-cd2755f119fb'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.057030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] The token cache is being invalidate because project a1b6ddcc3c834ec79482b17f2a2860c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:29.058117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.059834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.066263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 874/1751] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:28 2022] DELETE /identity/v3/projects/a1b6ddcc3c834ec79482b17f2a2860c1 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:29.068390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.071152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:29.093811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 878/1752] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:29.093811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.093811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.093811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.107675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2feb54-34e2-4fa1-842c-cd2755f119fb admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:29.113761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:29.114833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.115121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.115458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] PATH_INFO: `/v3/users/cdfe561853004a9d888ff6cf0762e411` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.117045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfe561853004a9d888ff6cf0762e411)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:29.119420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:29.145102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:29.147233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:29.172567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 879/1753] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:29.174925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.197161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700260-fe9e-41ca-87a8-76adb8cf1f39 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:29.203755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:29.204842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.205456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.207243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.208739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:29.209278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:29.211615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d56715-96d4-4729-80a9-ae6d5a15fc4a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:29.258189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 880/1754] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:29.264769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.265991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.266741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.291923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:29.293661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:29.319273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 881/1755] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:29.322534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.336934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e53ba-0260-4e8e-bc36-43fe25147a66 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:29.351466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:29.354481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.354889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.355268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.356092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:29.361202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:29.384316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfe561853004a9d888ff6cf0762e411'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.415156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfe561853004a9d888ff6cf0762e411'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.415907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfe561853004a9d888ff6cf0762e411'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.444897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfe561853004a9d888ff6cf0762e411'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.445644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfe561853004a9d888ff6cf0762e411'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:29.506719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 882/1756] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:29 2022] POST /identity/v3/projects => generated 359 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:29.507549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.512268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:29.559245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 875/1757] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:29 2022] DELETE /identity/v3/users/cdfe561853004a9d888ff6cf0762e411 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:29.560106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.567236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:29.801397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d711ff6-28c8-4e6a-879e-bc43c3c18e14 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:29.817317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86af5-802f-492c-a861-712a94a2701a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:29.827263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:29.827996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.829753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.831882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.832602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:29.834608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:29.847543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:29.848242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.848590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.849030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.849912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:29.859120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:29.859120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:29.905046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 883/1758] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:29.907267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.957294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d7d43-e759-4884-9000-57d4da77b78b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:29.975225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 876/1759] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:29 2022] POST /identity/v3/users => generated 280 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:29.979401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:29.980020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:29.981444 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:29.981963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:29.982489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:29.984594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:29.990229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:30.022813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5a7d-3de4-4769-bf34-709cfe40f30c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:30.062099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9355b12-e4dd-4ecf-beb0-54bfbf1e7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:30.063079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9355b12-e4dd-4ecf-beb0-54bfbf1e7b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.065180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9355b12-e4dd-4ecf-beb0-54bfbf1e7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.065637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9355b12-e4dd-4ecf-beb0-54bfbf1e7b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.068074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9355b12-e4dd-4ecf-beb0-54bfbf1e7b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:30.071638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9355b12-e4dd-4ecf-beb0-54bfbf1e7b8c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:30.085958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 877/1760] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:30.087949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9673da-5bf6-450e-971f-70ac3820d82f None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.088476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9673da-5bf6-450e-971f-70ac3820d82f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.089317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9673da-5bf6-450e-971f-70ac3820d82f None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.092302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 878/1761] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:30.093296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9673da-5bf6-450e-971f-70ac3820d82f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:30.114233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9673da-5bf6-450e-971f-70ac3820d82f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:30.124104 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a326cd-8578-4f87-8555-3d88ffb00df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:30.125345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a326cd-8578-4f87-8555-3d88ffb00df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.126074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a326cd-8578-4f87-8555-3d88ffb00df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.126619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a326cd-8578-4f87-8555-3d88ffb00df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.129655 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a326cd-8578-4f87-8555-3d88ffb00df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:30.132060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a326cd-8578-4f87-8555-3d88ffb00df2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:30.149949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 879/1762] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:30.152055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.152637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.153410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.161025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 884/1763] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:29 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:30.166339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:30.225746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:30.228668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:30.353552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc4358-115b-4f48-8de9-8b105643b62b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:30.371906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:30.374202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.374763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.376181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] PATH_INFO: `/v3/projects/70a1d4d2ff2a4848b7c1150eb046dbd4/users/2e4efe4a22a74f1cb91900fee1bed10b/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.423496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 880/1764] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:30.424662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:30.425075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a1d4d2ff2a4848b7c1150eb046dbd4, user_id=2e4efe4a22a74f1cb91900fee1bed10b, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:30.431234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:30.450140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77444d29-6e62-4781-89cb-4a514c5afd0b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:30.458665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:30.459875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.460432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.460996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.463463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:30.467457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:30.536154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 885/1765] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:30 2022] PUT /identity/v3/projects/70a1d4d2ff2a4848b7c1150eb046dbd4/users/2e4efe4a22a74f1cb91900fee1bed10b/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:30.539020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:30.548172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:30.598674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 881/1766] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:30 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:30.598674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:30.602758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:30.671991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1943b9-d4e9-4abc-a570-30dc6623e9e8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:30.796793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec5d2f-bc24-4792-870a-ac3663969792 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:30.805833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30e06-1f19-418c-8d37-e97fa30a9717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:30.806894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30e06-1f19-418c-8d37-e97fa30a9717 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.807739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30e06-1f19-418c-8d37-e97fa30a9717 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.808371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30e06-1f19-418c-8d37-e97fa30a9717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.834251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30e06-1f19-418c-8d37-e97fa30a9717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:30.836761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30e06-1f19-418c-8d37-e97fa30a9717 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:30.850625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 886/1767] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:30.852644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.853237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.853791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:30.899904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] MFA Rules not processed for user `2e4efe4a22a74f1cb91900fee1bed10b`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:30.924023 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:30.986323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:30.987760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:30.988043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:30.988524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] PATH_INFO: `/v3/projects/7ebc588f80bc437793b692f62653f259` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.011283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebc588f80bc437793b692f62653f259)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:31.020020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 887/1768] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:31.021148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:31.036489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:31.047413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67972e88-3fc6-427c-b10a-6591e15d4a67 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:31.064509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:31.065740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.066270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.066810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.067799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:31.070133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:31.104352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 888/1769] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:31.105600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:31.108571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:31.191354 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163201ae-6020-458d-a4e7-ba98d8ad1ab4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:31.197498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:31.198357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.199562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.200062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.212494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:31.219517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:31.244897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 889/1770] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:31 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:31.244897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:31.258408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c4c9-5b38-4179-bf47-f067e2570db0 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:31.286014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebc588f80bc437793b692f62653f259', 'request_id': 'req-393b8100-8d1b-45a3-a2b2-914153f69c6e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.302414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebc588f80bc437793b692f62653f259', 'request_id': 'req-393b8100-8d1b-45a3-a2b2-914153f69c6e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.330830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebc588f80bc437793b692f62653f259', 'request_id': 'req-393b8100-8d1b-45a3-a2b2-914153f69c6e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.334408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:31.335207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.335570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.335933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.337174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:31.339375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:31.354958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 890/1771] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:31.355920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:31.391477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0406-05e3-45dd-8913-c90972060d25 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:31.436154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:31.437055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.437425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.437776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] PATH_INFO: `/v3/users/2e4efe4a22a74f1cb91900fee1bed10b` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.441898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4efe4a22a74f1cb91900fee1bed10b)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:31.447511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:31.500098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] The token cache is being invalidate because project 7ebc588f80bc437793b692f62653f259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:31.500630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.501234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.510913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 882/1772] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:30 2022] DELETE /identity/v3/projects/7ebc588f80bc437793b692f62653f259 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:31.523994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:31.532279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:31.584808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8100-8d1b-45a3-a2b2-914153f69c6e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:31.598246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9068274-439c-4f22-a103-0ccddc1f34a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:31.614606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068274-439c-4f22-a103-0ccddc1f34a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.617036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068274-439c-4f22-a103-0ccddc1f34a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.617461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9068274-439c-4f22-a103-0ccddc1f34a2 admin admin] PATH_INFO: `/v3/projects/4d1b1f443f9d432aabc773e925ad8bbe/users/067c9483afa84171a8a1a19a118523ff/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.668518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4efe4a22a74f1cb91900fee1bed10b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.670373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4efe4a22a74f1cb91900fee1bed10b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.671870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4efe4a22a74f1cb91900fee1bed10b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.704332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9068274-439c-4f22-a103-0ccddc1f34a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1b1f443f9d432aabc773e925ad8bbe, user_id=067c9483afa84171a8a1a19a118523ff, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:31.704332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9068274-439c-4f22-a103-0ccddc1f34a2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:31.753948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4efe4a22a74f1cb91900fee1bed10b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.774746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-be3c7708-9824-4d5f-b716-229007a03a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4efe4a22a74f1cb91900fee1bed10b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:31.805692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 891/1773] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:31 2022] DELETE /identity/v3/users/2e4efe4a22a74f1cb91900fee1bed10b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:31.810249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f500eb0-0749-4e6c-86b9-b436f8b0ad84 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.810249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f500eb0-0749-4e6c-86b9-b436f8b0ad84 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.810249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f500eb0-0749-4e6c-86b9-b436f8b0ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.836916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 883/1774] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:31 2022] PUT /identity/v3/projects/4d1b1f443f9d432aabc773e925ad8bbe/users/067c9483afa84171a8a1a19a118523ff/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:31.839042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022e82c-0942-4f2e-ac7a-1586d5c8e8f1 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:31.843920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022e82c-0942-4f2e-ac7a-1586d5c8e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:31.845277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022e82c-0942-4f2e-ac7a-1586d5c8e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:31.923224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1022e82c-0942-4f2e-ac7a-1586d5c8e8f1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:31.925110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1022e82c-0942-4f2e-ac7a-1586d5c8e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:31.944484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7f500eb0-0749-4e6c-86b9-b436f8b0ad84 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:31.947079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7f500eb0-0749-4e6c-86b9-b436f8b0ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:32.149266 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 892/1775] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:32.150855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.154174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.154945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.220896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 884/1776] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:32.228273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] MFA Rules not processed for user `067c9483afa84171a8a1a19a118523ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:32.229344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.234711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:32.234866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.234866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.277666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:32.279102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:32.305300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 885/1777] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:32.309629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.329207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723ab77-a3dc-48af-80f0-9e6774aa2f59 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:32.341611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:32.341611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.343857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.345570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.348892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:32.349426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:32.354758 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 893/1778] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:32.357929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:32.361744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.366887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:32.389159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 886/1779] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:10:32.390680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.404871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390376f-9793-4782-8cf4-262c4fa2d703 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:32.415015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:32.415822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.416133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.421096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.421096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:32.421268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca2103-2495-4e65-8b9c-cb6721218b20 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:32.421343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:32.445264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:32.449793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.449793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.449793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.449793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:32.449793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:32.562717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 887/1780] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:32 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:32.563736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.576586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:32.633766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 894/1781] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:32 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:10:32.637005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.705311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b66da-b20b-44c5-acad-47e347e20f73 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:32.772982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb682ab-67c1-40eb-b5aa-99618b2153dd admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:32.778383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:32.779089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.779382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.779826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.780800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:32.783499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:32.869764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:32.871260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.871551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.871837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.888621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 895/1782] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:32 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:32.888621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.913189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:32.924238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:32.927166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9df9e5-6bb5-4170-901d-e244118ea079 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:32.943854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:32.944199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:32.944493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:32.944775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:32.945481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:32.953466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 888/1783] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:32.955188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:32.964566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:32.997133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeb108-6cc0-4cc4-af95-aa7d5557f6d3 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.010026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.010815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.011113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.011387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.012123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.029294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.058348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 889/1784] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:33.064323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.077700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbae4e-471d-43e8-b1a6-72488b04600b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.091863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 896/1785] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:32 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:33.097178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.102282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.103102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.103471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.103755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.106946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.114283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.129693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7568b8a-f91a-4690-8296-21499f574f86 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.151929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.151929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.151929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.151929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.152416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.152484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 890/1786] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:33.152484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.155378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.184763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9683-6bfe-4def-8971-4f96bb4cb563 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.199960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 897/1787] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:33.201068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f518b5-2bde-4454-a659-a2df22c42e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.203711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.204012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f518b5-2bde-4454-a659-a2df22c42e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.204276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f518b5-2bde-4454-a659-a2df22c42e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.207721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f518b5-2bde-4454-a659-a2df22c42e15 admin admin] PATH_INFO: `/v3/projects/1ca366dd7f424afa84f7a4bb5255652a/users/0893f54529a64a59b00ced9da3ceb1bc/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.240769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a459d4c-2037-46d2-ad49-fe68229f4e71 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.253154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.256205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.261632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f518b5-2bde-4454-a659-a2df22c42e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca366dd7f424afa84f7a4bb5255652a, user_id=0893f54529a64a59b00ced9da3ceb1bc, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.262293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.263762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] PATH_INFO: `/v3/projects/1d8750805c0640e984c841cd897e627a/users/30451aedf8e74fbc88804896a0483379/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.275947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f518b5-2bde-4454-a659-a2df22c42e15 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.308479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8750805c0640e984c841cd897e627a, user_id=30451aedf8e74fbc88804896a0483379, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.314022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.394162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 891/1788] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:33 2022] PUT /identity/v3/projects/1ca366dd7f424afa84f7a4bb5255652a/users/0893f54529a64a59b00ced9da3ceb1bc/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:33.395822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.396218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.396569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.415430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 898/1789] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:33 2022] PUT /identity/v3/projects/1d8750805c0640e984c841cd897e627a/users/30451aedf8e74fbc88804896a0483379/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:33.420288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.467570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] MFA Rules not processed for user `0893f54529a64a59b00ced9da3ceb1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:33.470010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:33.541529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9eb0dc-75d3-4eed-ae90-24700b95746b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.559410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.564633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.576304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.576304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.580219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.588991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.612044 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 899/1790] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:10:33.613076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.622971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 892/1791] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:33.626166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33353a8-b1b9-47ea-8516-163c48cbff1b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.629809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:33.648743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898928d1-b1d5-46f8-901a-08015d1d117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.649562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898928d1-b1d5-46f8-901a-08015d1d117a admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.650777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898928d1-b1d5-46f8-901a-08015d1d117a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.651178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898928d1-b1d5-46f8-901a-08015d1d117a admin admin] PATH_INFO: `/v3/projects/1d8750805c0640e984c841cd897e627a/users/30451aedf8e74fbc88804896a0483379/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.653883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898928d1-b1d5-46f8-901a-08015d1d117a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8750805c0640e984c841cd897e627a, user_id=30451aedf8e74fbc88804896a0483379, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.658021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898928d1-b1d5-46f8-901a-08015d1d117a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.669890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea8462-ac23-49fd-a1ff-4691f5700b6c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:33.737106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 900/1792] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:33 2022] PUT /identity/v3/projects/1d8750805c0640e984c841cd897e627a/users/30451aedf8e74fbc88804896a0483379/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:33.742980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf33ee4-ab06-43b5-b430-2560a3bdfbe7 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.745547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf33ee4-ab06-43b5-b430-2560a3bdfbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.745547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf33ee4-ab06-43b5-b430-2560a3bdfbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.819059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ecf33ee4-ab06-43b5-b430-2560a3bdfbe7 None None] MFA Rules not processed for user `30451aedf8e74fbc88804896a0483379`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:33.821219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ecf33ee4-ab06-43b5-b430-2560a3bdfbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:33.829819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:33.841178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.841178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.841178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:33.841178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:33.843826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:33.986411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 901/1793] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:33.986411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:33.986411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:33.986411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.008808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] MFA Rules not processed for user `5adf6fccb73242bab32c2fdf0ea23ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:34.010050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:34.024050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 893/1794] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:33 2022] POST /identity/v3/projects => generated 373 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:34.026132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.037530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:34.111960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 902/1795] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:34.112989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.128362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0bb268-0764-4b18-b498-e77276b53e79 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.231492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd6b1a-176f-486d-812c-df813c42b94a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.247272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.248690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.249020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.249297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.269918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.272279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.273227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.273227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.276263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.280475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:34.397175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 903/1796] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:34 2022] POST /identity/v3/users => generated 293 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:34.402713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.428477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ac966-24b7-4454-a42a-4e5715579d9f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.479483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.482509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:34.485729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.486441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.486730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.488796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.488796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.489883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:34.509132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 894/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:34.531414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 904/1798] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:34.532825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.575116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76ac75-119a-424c-b95d-a3f82ebfabad service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.585806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.586762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.587048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.587409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] PATH_INFO: `/v3/projects/4ccb1f4112214903b4057d9df13e1209/users/468fe6aa505d4a92b881dc303d0371db/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.630756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccb1f4112214903b4057d9df13e1209, user_id=468fe6aa505d4a92b881dc303d0371db, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.633859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:34.712966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.718058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:34.747309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 895/1799] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:34 2022] PUT /identity/v3/projects/4ccb1f4112214903b4057d9df13e1209/users/468fe6aa505d4a92b881dc303d0371db/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:34.758429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.779346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7520af-15bc-44aa-8f3a-bc34ceaebea9 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.898041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d91f84-6f83-43fa-ad9f-1ddd128d9f00 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.910616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.914197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.914730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.915379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.916410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.919163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:34.946616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 896/1800] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:34.949329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:34.975199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397cb58-ea78-4921-879e-23def474b14f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:34.984570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.987586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.989030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.989397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] PATH_INFO: `/v3/projects/70a1d4d2ff2a4848b7c1150eb046dbd4` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.989754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc602b-668a-4be9-832d-c4ef5811719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:34.990844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc602b-668a-4be9-832d-c4ef5811719e admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:34.991350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc602b-668a-4be9-832d-c4ef5811719e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:34.991770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc602b-668a-4be9-832d-c4ef5811719e admin admin] PATH_INFO: `/v3/projects/4ccb1f4112214903b4057d9df13e1209/users/468fe6aa505d4a92b881dc303d0371db/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:34.993326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a1d4d2ff2a4848b7c1150eb046dbd4)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.996938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc602b-668a-4be9-832d-c4ef5811719e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccb1f4112214903b4057d9df13e1209, user_id=468fe6aa505d4a92b881dc303d0371db, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:34.998286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:35.001041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc602b-668a-4be9-832d-c4ef5811719e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:35.037200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 897/1801] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:34 2022] PUT /identity/v3/projects/4ccb1f4112214903b4057d9df13e1209/users/468fe6aa505d4a92b881dc303d0371db/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:35.055906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:35.056542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:35.057374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:35.114366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] MFA Rules not processed for user `468fe6aa505d4a92b881dc303d0371db`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:35.123932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:35.250756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a1d4d2ff2a4848b7c1150eb046dbd4', 'request_id': 'req-c63ce427-9f35-48d9-a5d5-984951f009ae'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:35.274228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 898/1802] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:35.359054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a1d4d2ff2a4848b7c1150eb046dbd4', 'request_id': 'req-c63ce427-9f35-48d9-a5d5-984951f009ae'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:35.366845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a1d4d2ff2a4848b7c1150eb046dbd4', 'request_id': 'req-c63ce427-9f35-48d9-a5d5-984951f009ae'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:35.394135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] The token cache is being invalidate because project 70a1d4d2ff2a4848b7c1150eb046dbd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:35.394926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:35.395878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:35.396182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c63ce427-9f35-48d9-a5d5-984951f009ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:35.400215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 905/1803] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:34 2022] DELETE /identity/v3/projects/70a1d4d2ff2a4848b7c1150eb046dbd4 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:35.406690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603efb6c-993f-4c31-bc17-8330ff4164bc None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:35.407256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603efb6c-993f-4c31-bc17-8330ff4164bc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:35.408014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603efb6c-993f-4c31-bc17-8330ff4164bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:35.447346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-603efb6c-993f-4c31-bc17-8330ff4164bc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:35.449066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-603efb6c-993f-4c31-bc17-8330ff4164bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:35.530510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5637b-f830-4a91-b885-e5ecf1ad15ca None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:35.544718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 906/1804] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:35.552300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:35.552675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:35.552873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:35.588563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:35.590409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:35.600560 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 907/1805] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:35.605623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:35.618416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc3a7-9af3-4773-8d19-f6e706270d6c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:35.619915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:35.620799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:35.621087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:35.626759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:35.626759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:35.626932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:35.626932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:35.626932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:35.626932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:35.627229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:35.627229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:35.628309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:35.655685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 908/1806] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:35.660664 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:35.680757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6190-d6e8-496b-938d-d9c62307a005 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:35.697059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:35.697732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:35.698082 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:35.698366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:35.703992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:35.706740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:35.728836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:35.730350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:35.770117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 899/1807] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:35.960667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 909/1808] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:35 2022] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:10:35.961246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:35.989203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94961cc4-562a-403f-9c94-603a3d26e653 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.065934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.066691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.066980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.067260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.067955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.070500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.231919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 900/1809] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:35 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:36.235647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.252901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d5a0b-d4c7-4593-8a9c-02365b12b4ef admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.257792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.258808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.259275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.259760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.260707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.262613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.275208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 910/1810] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:36.278960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.293259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cf5e9-5d7a-4529-b611-5da401130340 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.308798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.309552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.309843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.310157 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.311735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.312529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.327265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 901/1811] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:36.328510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.348206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564f37-e3f3-43cd-b153-82ad9712f718 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.358799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33267c59-dfd3-46d8-9cea-d7ba2c40080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.359706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267c59-dfd3-46d8-9cea-d7ba2c40080b admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.359994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267c59-dfd3-46d8-9cea-d7ba2c40080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.360265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33267c59-dfd3-46d8-9cea-d7ba2c40080b admin admin] PATH_INFO: `/v3/projects/19f3f0eacebd43cba64ebd89c60517a2/users/3da9a640a584477d983eba0656d9c93d/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.378972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267c59-dfd3-46d8-9cea-d7ba2c40080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f3f0eacebd43cba64ebd89c60517a2, user_id=3da9a640a584477d983eba0656d9c93d, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.381915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33267c59-dfd3-46d8-9cea-d7ba2c40080b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.385299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.387719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:36.488708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701ac09-347b-49fc-95b1-172470973ba2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.494242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 911/1812] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:36 2022] PUT /identity/v3/projects/19f3f0eacebd43cba64ebd89c60517a2/users/3da9a640a584477d983eba0656d9c93d/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:36.502017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.503067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.503810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.547851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] MFA Rules not processed for user `3da9a640a584477d983eba0656d9c93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:36.549324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:36.590717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30451aedf8e74fbc88804896a0483379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8750805c0640e984c841cd897e627a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.592332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.592872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.593319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.594487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:36.595049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.597684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.614826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 902/1813] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:36.615837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.617704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:36.660445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 912/1814] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:36.664228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.678661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69977d8a-74ca-4130-bf08-61954862a7de None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.688857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30451aedf8e74fbc88804896a0483379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8750805c0640e984c841cd897e627a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.691018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.691704 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.692197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.693556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.698699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.739485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea4d1f-783b-4a7b-8440-4d5a22459a86 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.743361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.744212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.744396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.744673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.751729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:36.816790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 913/1815] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:36 2022] POST /identity/v3/projects => generated 353 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:36.817886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.826400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.828144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.839145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 903/1816] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:36.840068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:36.852278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89ba82-060a-4d39-a5ee-11110a553981 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.969766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30451aedf8e74fbc88804896a0483379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8750805c0640e984c841cd897e627a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.970593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.970880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.971212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.972446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:36.972918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.973833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71368f8d-13a7-42fe-a3e0-806a94942e73 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:36.974886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.980430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:36.981262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:36.981557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:36.981838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:36.982772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:36.984679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:36.989252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 904/1817] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:37.038871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:37.053879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202a534-c57b-4d4a-8c12-b08a64105709 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:37.059607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30451aedf8e74fbc88804896a0483379', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d8750805c0640e984c841cd897e627a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:37.060926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.061269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.061554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] PATH_INFO: `/v3/projects/874be2b593f9487eb50bd214b38cdaab` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.062928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorizing `identity:delete_project(project_id=874be2b593f9487eb50bd214b38cdaab)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:37.065056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:37.085652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 914/1818] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:36 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:37.099782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:37.191685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b9cec-bde5-4c8a-9496-6454c1429eb0 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:37.201133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:37.204889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.205221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.205641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.206635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:37.209683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:37.273343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874be2b593f9487eb50bd214b38cdaab', 'request_id': 'req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:37.284841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874be2b593f9487eb50bd214b38cdaab', 'request_id': 'req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:37.293343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874be2b593f9487eb50bd214b38cdaab', 'request_id': 'req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:37.332488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 915/1819] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:37 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:37.337021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:37.349148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f9910-f662-4d92-96c5-95a92806264b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:37.379276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] The token cache is being invalidate because project 874be2b593f9487eb50bd214b38cdaab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:37.379615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:37.381315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:37.386404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 905/1820] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:37 2022] DELETE /identity/v3/projects/874be2b593f9487eb50bd214b38cdaab => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:37.462284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:37.462986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.463752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.464094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.465072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:37.495480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:37.514439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 916/1821] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:37.515497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:37.517024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:37.556470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc00a0-7d6c-4c04-b347-5c468f86a3d3 tempest-VolumeQuotaClassesTest-983540313 tempest-VolumeQuotaClassesTest-983540313-project-admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:37.561238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:37.562410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.562883 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.563337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] PATH_INFO: `/v3/projects/9ace4ccb41e444bf9e4964a682ba271f/users/999638421f1244979a4ee26f967b3900/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.586587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ace4ccb41e444bf9e4964a682ba271f, user_id=999638421f1244979a4ee26f967b3900, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:37.590202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:37.657546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 906/1822] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:37 2022] PUT /identity/v3/projects/9ace4ccb41e444bf9e4964a682ba271f/users/999638421f1244979a4ee26f967b3900/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:37.661498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:37.672297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ae83-0090-4a59-9e54-eb67a759bc92 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:37.741694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf13cd-bbef-495a-8652-4f62b5d26d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:37.742572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf13cd-bbef-495a-8652-4f62b5d26d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.742924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf13cd-bbef-495a-8652-4f62b5d26d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.743213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf13cd-bbef-495a-8652-4f62b5d26d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.743951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf13cd-bbef-495a-8652-4f62b5d26d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:37.746098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf13cd-bbef-495a-8652-4f62b5d26d2c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:37.757509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 917/1823] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:37.762020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:37.777279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109f81-0c1f-46f1-aff0-fcb7c112a723 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:37.782520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:37.784515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.785346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.785346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] PATH_INFO: `/v3/projects/9ace4ccb41e444bf9e4964a682ba271f/users/999638421f1244979a4ee26f967b3900/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.787213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ace4ccb41e444bf9e4964a682ba271f, user_id=999638421f1244979a4ee26f967b3900, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:37.790339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:37.803705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 907/1824] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:37 2022] PUT /identity/v3/projects/9ace4ccb41e444bf9e4964a682ba271f/users/999638421f1244979a4ee26f967b3900/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:37.816304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:37.818033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:37.818494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:37.854693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] MFA Rules not processed for user `999638421f1244979a4ee26f967b3900`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:37.855967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:37.938220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 918/1825] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:38.087396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:38.089374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:38.125838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:38.127808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:38.202323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49740d62-8866-4bc8-8a15-cb2d63e07ea1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:38.206536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:38.207209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:38.207498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:38.207784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:38.209640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:38.234194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f77486-d555-404d-b6d3-1e6578d1d783 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:38.244055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:38.245034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:38.245454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:38.245729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] PATH_INFO: `/v3/users/067c9483afa84171a8a1a19a118523ff` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:38.262779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=067c9483afa84171a8a1a19a118523ff)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:38.278502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:38.283074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcaee3e-3ee6-46ad-887c-d7d255af18af service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:38.283223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:38.291312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 908/1826] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:38.548442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067c9483afa84171a8a1a19a118523ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:38.550820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067c9483afa84171a8a1a19a118523ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:38.552264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067c9483afa84171a8a1a19a118523ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:38.633105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067c9483afa84171a8a1a19a118523ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:38.652787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067c9483afa84171a8a1a19a118523ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:38.689510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 919/1827] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:38 2022] DELETE /identity/v3/users/067c9483afa84171a8a1a19a118523ff => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:38.692909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:38.692909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:38.693539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:38.718656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:38.719905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:38.806272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 909/1828] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:38.813188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:38.814711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:38.874649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ef8c-6203-45f3-9e72-ab06f6fa4b5f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:38.878802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:38.879910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:38.879910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:38.880117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:38.891954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:38.894195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:38.905239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 920/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:39.280739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:39.282603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:39.304279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c31c40-1a32-450c-91a1-576bca205142 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:39.316924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:39.318077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:39.318506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:39.318951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] PATH_INFO: `/v3/users/de56ade133e34443ba7d606eb5958c92` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:39.320605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de56ade133e34443ba7d606eb5958c92)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:39.322789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:39.372124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:39.373738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:39.403982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c97f0-057b-42f1-8e58-9f434c539e98 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:39.411115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:39.412150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:39.412904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:39.413184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] PATH_INFO: `/v3/projects/4d1b1f443f9d432aabc773e925ad8bbe` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:39.414739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1b1f443f9d432aabc773e925ad8bbe)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:39.417793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:39.542013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de56ade133e34443ba7d606eb5958c92'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.553412 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1b1f443f9d432aabc773e925ad8bbe', 'request_id': 'req-6b8a4cf7-9831-4157-94cc-8cc4270133cb'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.562087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de56ade133e34443ba7d606eb5958c92'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.562939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de56ade133e34443ba7d606eb5958c92'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.571065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de56ade133e34443ba7d606eb5958c92'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.571964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fae14177-f19b-4a62-8446-1ea54eb494b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de56ade133e34443ba7d606eb5958c92'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.611000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1b1f443f9d432aabc773e925ad8bbe', 'request_id': 'req-6b8a4cf7-9831-4157-94cc-8cc4270133cb'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.618915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1b1f443f9d432aabc773e925ad8bbe', 'request_id': 'req-6b8a4cf7-9831-4157-94cc-8cc4270133cb'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.632992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] The token cache is being invalidate because project 4d1b1f443f9d432aabc773e925ad8bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:39.633304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.633959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:39.635785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 921/1830] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:39 2022] DELETE /identity/v3/projects/4d1b1f443f9d432aabc773e925ad8bbe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:39.639435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:39.641616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:39.702412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 910/1831] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:39 2022] DELETE /identity/v3/users/de56ade133e34443ba7d606eb5958c92 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:39.711688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:39.712359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:39.712786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:39.724819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a4cf7-9831-4157-94cc-8cc4270133cb admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:39.735511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:39.738232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:39.821868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:39.823014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:39.823403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:39.823782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] PATH_INFO: `/v3/users/30451aedf8e74fbc88804896a0483379` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:39.825113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30451aedf8e74fbc88804896a0483379)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:39.827227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:39.830014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 911/1832] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:39.845164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:39.846787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:39.908328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4719b-8f87-4fac-8fca-0be7dd8c097a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:39.913818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:39.914918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:39.914918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:39.915368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:39.925797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:39.927370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:39.937407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 912/1833] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:10:40.061827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30451aedf8e74fbc88804896a0483379'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.062824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30451aedf8e74fbc88804896a0483379'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.063700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30451aedf8e74fbc88804896a0483379'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.147959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30451aedf8e74fbc88804896a0483379'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.168319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30451aedf8e74fbc88804896a0483379'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.211844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 922/1834] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:39 2022] DELETE /identity/v3/users/30451aedf8e74fbc88804896a0483379 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:40.535526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:40.536966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:40.571237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ba82c-868b-4ff2-8326-e0073f5ed797 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:40.692124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:40.696817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:40.696970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:40.698673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] PATH_INFO: `/v3/projects/5982c4c40b57402099f23e2d86537f25` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:40.702017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5982c4c40b57402099f23e2d86537f25)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:40.704098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:40.837194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:40.839283 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:40.841909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5982c4c40b57402099f23e2d86537f25', 'request_id': 'req-6f9a944b-f7f5-4e74-85a9-a253161e949c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.854186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5982c4c40b57402099f23e2d86537f25', 'request_id': 'req-6f9a944b-f7f5-4e74-85a9-a253161e949c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:40.862867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100623c-8119-484b-be29-fad7485ce27b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:40.872582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5982c4c40b57402099f23e2d86537f25', 'request_id': 'req-6f9a944b-f7f5-4e74-85a9-a253161e949c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.004088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.005363 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.005842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.006323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] PATH_INFO: `/v3/projects/1d8750805c0640e984c841cd897e627a` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.008375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8750805c0640e984c841cd897e627a)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.010754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.013249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] The token cache is being invalidate because project 5982c4c40b57402099f23e2d86537f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:41.013780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.014964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6f9a944b-f7f5-4e74-85a9-a253161e949c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.027711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 913/1835] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:40 2022] DELETE /identity/v3/projects/5982c4c40b57402099f23e2d86537f25 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:41.027711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b149b68-ff04-4c27-9462-841baf971763 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.027711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b149b68-ff04-4c27-9462-841baf971763 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.027711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b149b68-ff04-4c27-9462-841baf971763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.065639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1b149b68-ff04-4c27-9462-841baf971763 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:41.066914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1b149b68-ff04-4c27-9462-841baf971763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:41.082096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 914/1836] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:41.098789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.099084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.099371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.133342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:41.134646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:41.164305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8750805c0640e984c841cd897e627a', 'request_id': 'req-63361169-796f-43ea-a17a-ae3c7b513da8'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.234047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8750805c0640e984c841cd897e627a', 'request_id': 'req-63361169-796f-43ea-a17a-ae3c7b513da8'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.242206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8750805c0640e984c841cd897e627a', 'request_id': 'req-63361169-796f-43ea-a17a-ae3c7b513da8'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.260720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 915/1837] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:41.264513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.269101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] The token cache is being invalidate because project 1d8750805c0640e984c841cd897e627a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:41.269618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.271290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-63361169-796f-43ea-a17a-ae3c7b513da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:41.277324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 923/1838] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:40 2022] DELETE /identity/v3/projects/1d8750805c0640e984c841cd897e627a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:41.277495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b28c0-81d6-4260-ae96-f952e4cb0909 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.279384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70cfe4-1e81-4aa5-979c-37018854e92c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.279622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70cfe4-1e81-4aa5-979c-37018854e92c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.280722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70cfe4-1e81-4aa5-979c-37018854e92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.291828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.292515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.292801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.293173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.293806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:41.294170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.295813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.315670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-be70cfe4-1e81-4aa5-979c-37018854e92c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:41.317156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-be70cfe4-1e81-4aa5-979c-37018854e92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:41.322544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 916/1839] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:41.325390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.330859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:41.334118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 924/1840] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:41.344792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.345078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.345354 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.345545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474c8b5-b89b-4fc2-864d-a8c2ef879601 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.351146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.352819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.352819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.352819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.353070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.355048 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.365478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:41.366838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:41.376611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 925/1841] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:41.381333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.397360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044966ea-7d1f-4019-81ec-10e5bab35a9f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.402208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.408400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.411849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.411849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.411849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:41.411849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.413302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.429169 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 926/1842] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:10:41.436962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 917/1843] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:41.438172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.441726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.457537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ab4b8-6c73-4ec5-8255-ac4064a8d081 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.536708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.537194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a426cf7-e71d-4080-bf9a-b8bb692e37f3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.537345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.537821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.538143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.538829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.541497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.543584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.544476 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.544901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.545312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.546232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.548308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.625501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 927/1844] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/projects => generated 409 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:41.629947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.631378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 918/1845] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:41.634942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.648800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a226f-e645-460c-b985-9b514bd0eb53 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.719919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.720756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.721906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.722176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.723302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.725313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.743738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 919/1846] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:41.746158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.749080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:41.755783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834fdf2-b6e1-4c39-b327-665842f5d1c4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.763167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.764203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ff0cc-d226-4a76-89c4-5cc8911382e3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.764512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.765042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.765535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.766744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.775422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.775924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.776902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.777178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.777507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] PATH_INFO: `/v3/users/3da9a640a584477d983eba0656d9c93d` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.778919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da9a640a584477d983eba0656d9c93d)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.780904 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.895060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 928/1847] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:41 2022] POST /identity/v3/users => generated 305 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:41.895060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.904425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d470f53-d79a-4a5b-be79-1bd980acaa87 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.923229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.923229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.923229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.923229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.923536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.923536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.929077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 929/1848] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:41.929822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.940713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bee57e-0e35-436b-94b8-7182dc9b3730 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.946699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.950482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.950482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.950482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:41.950482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:41.950482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:41.963394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 930/1849] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:41.964668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:41.984028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7a22-c0bd-49ba-b796-c1d1e718fccf admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:41.990572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:41.991583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:41.991921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:41.992263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] PATH_INFO: `/v3/projects/a9e9e8beec5640879b2eb56517b6ee6e/users/7f56e77ef09d412aa3fb3baead2948d2/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.003124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da9a640a584477d983eba0656d9c93d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:42.011623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e9e8beec5640879b2eb56517b6ee6e, user_id=7f56e77ef09d412aa3fb3baead2948d2, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.014425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.027482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da9a640a584477d983eba0656d9c93d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:42.028222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da9a640a584477d983eba0656d9c93d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:42.036009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da9a640a584477d983eba0656d9c93d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:42.036758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9754afd3-f682-4783-9419-e71e9e20b816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da9a640a584477d983eba0656d9c93d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:42.108651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 931/1850] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:41 2022] PUT /identity/v3/projects/a9e9e8beec5640879b2eb56517b6ee6e/users/7f56e77ef09d412aa3fb3baead2948d2/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:42.109496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.111137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:42.130965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 920/1851] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:41 2022] DELETE /identity/v3/users/3da9a640a584477d983eba0656d9c93d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:42.132356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0058e5-8f01-4fe2-b966-5ee5b6995edc None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.132645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0058e5-8f01-4fe2-b966-5ee5b6995edc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.132922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0058e5-8f01-4fe2-b966-5ee5b6995edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.191762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3d0058e5-8f01-4fe2-b966-5ee5b6995edc None None] MFA Rules not processed for user `7f56e77ef09d412aa3fb3baead2948d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:42.191762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3d0058e5-8f01-4fe2-b966-5ee5b6995edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:42.218498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea16dc-8ee7-4d66-91b8-63f2256bbd3d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.283318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 921/1852] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:42.284877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.285164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.285443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.302281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.303314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.303606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.304512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.305327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.306977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.307251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:42.308997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:42.317637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 922/1853] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:42.318363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.319793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:42.321122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 932/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:42.326955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.331462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65dbe-4202-4edd-b5f4-8326cc825968 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.336108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.336769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.337046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.337316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.338023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.339297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4959379-1e41-4332-a8db-04e82c0b821d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.340085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.349355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.350270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.350556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.350831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] PATH_INFO: `/v3/projects/d6d08f16b3644f7098b56f941e1e1f75/users/f189d3dfa98c4529b82bc8496264d93e/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.366027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d08f16b3644f7098b56f941e1e1f75, user_id=f189d3dfa98c4529b82bc8496264d93e, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.368672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.434027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 923/1855] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:42.435093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.438348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:42.454419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 933/1856] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:42 2022] PUT /identity/v3/projects/d6d08f16b3644f7098b56f941e1e1f75/users/f189d3dfa98c4529b82bc8496264d93e/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:42.463468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.496824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b031753-cf5e-4652-a36d-6ec61c17e5ae admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.516775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b163e-7821-4353-95de-340f7ed4cff0 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.521485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.522187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.522478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.522756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.523446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.525362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.544308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f097e2-ea78-4703-9552-d18be8284d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.544993 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f097e2-ea78-4703-9552-d18be8284d21 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.546017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f097e2-ea78-4703-9552-d18be8284d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.546017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f097e2-ea78-4703-9552-d18be8284d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.555143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f097e2-ea78-4703-9552-d18be8284d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.556606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f097e2-ea78-4703-9552-d18be8284d21 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.565752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 924/1857] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:42.566965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.567254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.567531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.592337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] MFA Rules not processed for user `f189d3dfa98c4529b82bc8496264d93e`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:42.593533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:42.623149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 934/1858] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:42.627032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.640654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec73713-5c9a-4b8b-9efd-115502ffbdb8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.646646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.647317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.647601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.647878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.648950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.650759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.665525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 935/1859] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:10:42.666561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.672240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 925/1860] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:42.677494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.680080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27f7c-fcbe-4d67-80f7-c732577b4174 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.685058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.685703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.686010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.686300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] PATH_INFO: `/v3/projects/8f8e5c53c42343c4ba37810f5a71ea1e/users/2f559688abba4a69b55e2dd6e1ad6e8a/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.691218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c87711-80a1-4f5a-977c-96d578eb38c0 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.696258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.696838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.701030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.701030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.701030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.701030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.702783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8e5c53c42343c4ba37810f5a71ea1e, user_id=2f559688abba4a69b55e2dd6e1ad6e8a, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.705771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.764942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 936/1861] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:42 2022] PUT /identity/v3/projects/8f8e5c53c42343c4ba37810f5a71ea1e/users/2f559688abba4a69b55e2dd6e1ad6e8a/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:42.766669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 926/1862] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/projects => generated 407 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:42.769133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.772420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.846242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f6a13-d259-4400-8cea-0eec3079f961 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.857099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be86db-d6b5-4397-8591-4c934ef17558 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.862880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.863810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.867211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.867211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.867211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.867452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.918205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.919487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.919880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.920223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.921054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.922783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.935027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 937/1863] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:42.936323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 927/1864] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/users => generated 310 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:42.940313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.940435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.950121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ef6c-aa04-4201-b91e-807f7d81e5cb admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.950496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b5b0b-5c2f-44c0-ba11-4d3418c05adf admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.954757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.959095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6969aa-ceaf-4400-96fb-3a42d2a2c01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:42.959216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.959216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.959216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.959453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6969aa-ceaf-4400-96fb-3a42d2a2c01d admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.959453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6969aa-ceaf-4400-96fb-3a42d2a2c01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.959453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6969aa-ceaf-4400-96fb-3a42d2a2c01d admin admin] PATH_INFO: `/v3/projects/8f8e5c53c42343c4ba37810f5a71ea1e/users/2f559688abba4a69b55e2dd6e1ad6e8a/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:42.959665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.959665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.959818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6969aa-ceaf-4400-96fb-3a42d2a2c01d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8e5c53c42343c4ba37810f5a71ea1e, user_id=2f559688abba4a69b55e2dd6e1ad6e8a, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:42.961620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6969aa-ceaf-4400-96fb-3a42d2a2c01d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:42.968876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 928/1865] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:42.973616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:42.974099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 938/1866] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:42 2022] PUT /identity/v3/projects/8f8e5c53c42343c4ba37810f5a71ea1e/users/2f559688abba4a69b55e2dd6e1ad6e8a/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:42.983935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25702781-e00c-4b8c-b4c3-762d0d62317f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:42.991067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:42.991360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:42.991646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.022964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] MFA Rules not processed for user `2f559688abba4a69b55e2dd6e1ad6e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:43.024766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.044821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.045812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.046207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.046487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] PATH_INFO: `/v3/projects/f35e2ba57f72453d9f6c4f0b716b6d6c/users/1e123d20f9764387893ae758c5b91591/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.061330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35e2ba57f72453d9f6c4f0b716b6d6c, user_id=1e123d20f9764387893ae758c5b91591, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.064269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.096338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 939/1867] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:43.097182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.098504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.112264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e47a50-2300-4fd9-9e1d-20ff7d96eb89 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.116782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.117617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.117896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.118206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] PATH_INFO: `/v3/projects/19f3f0eacebd43cba64ebd89c60517a2` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.119373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f3f0eacebd43cba64ebd89c60517a2)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.121336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.147152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 929/1868] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:42 2022] PUT /identity/v3/projects/f35e2ba57f72453d9f6c4f0b716b6d6c/users/1e123d20f9764387893ae758c5b91591/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:10:43.147995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.149614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.205120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83637-ae6b-4edd-93d0-8b33e6d7e1b3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.209332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.210090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.210375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.210805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.224985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f3f0eacebd43cba64ebd89c60517a2', 'request_id': 'req-d413605d-5dcd-4fbb-8689-216e447b659a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.271989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.274552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f3f0eacebd43cba64ebd89c60517a2', 'request_id': 'req-d413605d-5dcd-4fbb-8689-216e447b659a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.274647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.281782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f3f0eacebd43cba64ebd89c60517a2', 'request_id': 'req-d413605d-5dcd-4fbb-8689-216e447b659a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.285389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 930/1869] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:43.286273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.313467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] The token cache is being invalidate because project 19f3f0eacebd43cba64ebd89c60517a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:43.314924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.316899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.320843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 940/1870] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:43 2022] DELETE /identity/v3/projects/19f3f0eacebd43cba64ebd89c60517a2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:43.324261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.326861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.369834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b4584-c3c3-4c81-848e-70cd7f288328 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.434429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413605d-5dcd-4fbb-8689-216e447b659a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.443791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.444807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.445154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.445530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] PATH_INFO: `/v3/users/999638421f1244979a4ee26f967b3900` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.447649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999638421f1244979a4ee26f967b3900)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.450260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.476259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.480233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.485856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.486391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.488149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.490222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.506553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 931/1871] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:43.506553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.506553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.569999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b929d5-3417-4888-bd13-1341b8965b5c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.574534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.575213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.575505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.575821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.577568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.597531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999638421f1244979a4ee26f967b3900'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.598236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999638421f1244979a4ee26f967b3900'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.598906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999638421f1244979a4ee26f967b3900'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.638891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999638421f1244979a4ee26f967b3900'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.645042 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.646559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.647828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fbf55a37-e377-4259-a1db-9d30760e8370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999638421f1244979a4ee26f967b3900'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:43.656526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 932/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:43.657468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.659427 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.679169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1cec-b082-4d06-ac4f-b93fbfb74059 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.679307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 941/1873] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:10:43 2022] DELETE /identity/v3/users/999638421f1244979a4ee26f967b3900 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:43.736946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.737853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.738159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.738625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] PATH_INFO: `/v3/projects/f35e2ba57f72453d9f6c4f0b716b6d6c/users/1e123d20f9764387893ae758c5b91591/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.741751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35e2ba57f72453d9f6c4f0b716b6d6c, user_id=1e123d20f9764387893ae758c5b91591, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.743338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.754415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 933/1874] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:43 2022] PUT /identity/v3/projects/f35e2ba57f72453d9f6c4f0b716b6d6c/users/1e123d20f9764387893ae758c5b91591/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:43.765546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.765935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.766306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.794067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] MFA Rules not processed for user `1e123d20f9764387893ae758c5b91591`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:43.795243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.864484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 942/1875] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:43 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:43.875184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:43.876890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:43.956228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e7200-41c5-492d-af21-418b4af129f2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:43.960498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d625-66d2-4166-b7a7-5f7a4d442da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:43.961526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d625-66d2-4166-b7a7-5f7a4d442da2 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:43.961699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d625-66d2-4166-b7a7-5f7a4d442da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:43.962114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d625-66d2-4166-b7a7-5f7a4d442da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:43.971998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d625-66d2-4166-b7a7-5f7a4d442da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:43.973687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d625-66d2-4166-b7a7-5f7a4d442da2 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:43.984366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 934/1876] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:43 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:44.063924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:44.065762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:44.174822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96afdc-ded1-424e-a377-9c9d8e2b843d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:44.179922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:44.180795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.181079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.181358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] PATH_INFO: `/v3/projects/9ace4ccb41e444bf9e4964a682ba271f` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.182653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ace4ccb41e444bf9e4964a682ba271f)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:44.184561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:44.297995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ace4ccb41e444bf9e4964a682ba271f', 'request_id': 'req-f382259f-254e-4ae7-b791-29fa0336462a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:44.382237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ace4ccb41e444bf9e4964a682ba271f', 'request_id': 'req-f382259f-254e-4ae7-b791-29fa0336462a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:44.397396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ace4ccb41e444bf9e4964a682ba271f', 'request_id': 'req-f382259f-254e-4ae7-b791-29fa0336462a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:44.416862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] The token cache is being invalidate because project 9ace4ccb41e444bf9e4964a682ba271f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:10:44.417211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:44.417958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:10:44.422038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 943/1877] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:10:44 2022] DELETE /identity/v3/projects/9ace4ccb41e444bf9e4964a682ba271f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:44.425897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0290e7-933b-4de1-9e4c-02c0c5211e1c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.426216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0290e7-933b-4de1-9e4c-02c0c5211e1c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.426501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0290e7-933b-4de1-9e4c-02c0c5211e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.446732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-cd0290e7-933b-4de1-9e4c-02c0c5211e1c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:44.448112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-cd0290e7-933b-4de1-9e4c-02c0c5211e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:44.523727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:44.525876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:44.549722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 935/1878] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:44.558129 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.558612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.558955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.587057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:44.588630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:44.598966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 936/1879] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:10:44.612849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:44.634328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d4959-395e-4f25-bca8-9cc23a10cacf None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:44.650931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382259f-254e-4ae7-b791-29fa0336462a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:44.652330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:44.653289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.653450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.653700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.654470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:10:44.654876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:44.657851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:44.658379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:44.659096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.660042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.660811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.663165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:44.688938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 937/1880] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:10:44.693324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:44.712371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d80c9-2bf7-44ce-b307-56423e139f31 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:44.721420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:44.722439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.730269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.731054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.731989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:44.734245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:44.749522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:44.751768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:44.770974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 944/1881] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:10:44.855736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 938/1882] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:10:44 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:44.860630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:44.872224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36137d1-2aaa-4b3f-9579-6e8bff559bf5 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:44.943706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:44.944389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:44.944674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:44.944950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:44.945671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:44.947641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:45.053408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 945/1883] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:10:44 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:10:45.054942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:45.065339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0399b36-d50b-4c13-8c53-76885709c99b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:45.069959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:45.070666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:45.070950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:45.071227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:45.071947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:45.073531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:45.083465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 939/1884] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:45.087656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:45.098482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f4619-275c-4f92-a11e-36753172f259 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:45.103161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c0858-284c-4954-bfb2-d20dd129caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:45.103829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0858-284c-4954-bfb2-d20dd129caa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:45.104115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0858-284c-4954-bfb2-d20dd129caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:45.104426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c0858-284c-4954-bfb2-d20dd129caa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:45.105243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0858-284c-4954-bfb2-d20dd129caa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:45.106994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c0858-284c-4954-bfb2-d20dd129caa9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:45.120834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 946/1885] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:10:45.122027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:45.132638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec3071-bbfc-449c-bec5-918d0db481c0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:45.139639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:45.143266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:45.143266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:45.143266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] PATH_INFO: `/v3/projects/764fcc43383b4b6d851076349834e4ee/users/0465e535bf764a95a9cb8104a8f1bdcc/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:45.163628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] RBAC: Authorizing `identity:create_grant(project_id=764fcc43383b4b6d851076349834e4ee, user_id=0465e535bf764a95a9cb8104a8f1bdcc, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:45.167364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:45.250694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 940/1886] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:10:45 2022] PUT /identity/v3/projects/764fcc43383b4b6d851076349834e4ee/users/0465e535bf764a95a9cb8104a8f1bdcc/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:10:45.262139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32959a4b-30df-418a-8c1c-6ad75983553d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:45.262430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32959a4b-30df-418a-8c1c-6ad75983553d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:45.262712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32959a4b-30df-418a-8c1c-6ad75983553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:45.291112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-32959a4b-30df-418a-8c1c-6ad75983553d None None] MFA Rules not processed for user `0465e535bf764a95a9cb8104a8f1bdcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:45.292328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-32959a4b-30df-418a-8c1c-6ad75983553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:45.356292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 947/1887] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:10:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:45.818384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:45.820171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:45.879556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8de11a-1ded-4ada-96d0-993c2d61761d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:45.883359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f0318-2980-47ce-9379-16794b9628a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:45.884105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f0318-2980-47ce-9379-16794b9628a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:45.884459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f0318-2980-47ce-9379-16794b9628a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:45.884807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f0318-2980-47ce-9379-16794b9628a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:45.894854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f0318-2980-47ce-9379-16794b9628a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:45.896385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f0318-2980-47ce-9379-16794b9628a1 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:45.913309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 941/1888] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:10:47.631717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a81b-0eeb-4675-a0d7-4c569791e277 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:47.632264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a81b-0eeb-4675-a0d7-4c569791e277 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:47.632264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214a81b-0eeb-4675-a0d7-4c569791e277 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:47.634425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 948/1889] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:10:47.645780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:47.646210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:47.646516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:47.664400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:10:47.665601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:47.735596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 942/1890] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:10:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:10:47.757069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214a81b-0eeb-4675-a0d7-4c569791e277 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:10:47.758920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d214a81b-0eeb-4675-a0d7-4c569791e277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:10:47.777231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214a81b-0eeb-4675-a0d7-4c569791e277 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:10:47.783820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a75c5-bd37-4e0d-b1df-c097564949a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:10:47.784474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a75c5-bd37-4e0d-b1df-c097564949a5 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:10:47.784762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a75c5-bd37-4e0d-b1df-c097564949a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:10:47.785041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a75c5-bd37-4e0d-b1df-c097564949a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:10:47.794805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a75c5-bd37-4e0d-b1df-c097564949a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:10:47.796743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a75c5-bd37-4e0d-b1df-c097564949a5 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:10:47.808384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 949/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:10:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:00.964642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:00.966205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:01.043230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61149c49-aa40-4db9-98ce-ab5b8e48e760 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:01.048331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:01.055025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:01.061595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:01.061595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] PATH_INFO: `/v3/users/f189d3dfa98c4529b82bc8496264d93e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:01.061595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f189d3dfa98c4529b82bc8496264d93e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:01.061595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:01.299968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f189d3dfa98c4529b82bc8496264d93e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:01.313760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f189d3dfa98c4529b82bc8496264d93e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:01.314524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f189d3dfa98c4529b82bc8496264d93e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:01.322220 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f189d3dfa98c4529b82bc8496264d93e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:01.322966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f189d3dfa98c4529b82bc8496264d93e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:01.406296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 943/1892] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:00 2022] DELETE /identity/v3/users/f189d3dfa98c4529b82bc8496264d93e => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:01.410317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:01.411244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:01.411934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:01.472259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:01.473959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:01.584408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 950/1893] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:01.601958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:01.601958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:01.692516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ea383-0dbb-45ac-ab29-8f9b34db01cb admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:01.696945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:01.698577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:01.698577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:01.698577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:01.718875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:01.720342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:01.741836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 944/1894] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:02.111489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:02.113556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:02.126205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf5fb8-bf67-4cd3-bf69-38e83fc8a025 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:02.131462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:02.132536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:02.132826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:02.133106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] PATH_INFO: `/v3/users/75fd33c6e67b443eaae5eb01740ad3ef` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:02.134423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fd33c6e67b443eaae5eb01740ad3ef)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:02.136479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:02.183437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:02.183892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:02.197635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628254f-ba3a-453e-920e-8142551ce596 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:02.202519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:02.203387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:02.203695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:02.203974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] PATH_INFO: `/v3/projects/d6d08f16b3644f7098b56f941e1e1f75` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:02.205163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d08f16b3644f7098b56f941e1e1f75)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:02.207686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:02.342904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fd33c6e67b443eaae5eb01740ad3ef'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.343605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fd33c6e67b443eaae5eb01740ad3ef'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.344216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fd33c6e67b443eaae5eb01740ad3ef'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.347791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d08f16b3644f7098b56f941e1e1f75', 'request_id': 'req-2551b99f-ec40-4ac8-9642-35fd3d31e47f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.353929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d08f16b3644f7098b56f941e1e1f75', 'request_id': 'req-2551b99f-ec40-4ac8-9642-35fd3d31e47f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.360182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d08f16b3644f7098b56f941e1e1f75', 'request_id': 'req-2551b99f-ec40-4ac8-9642-35fd3d31e47f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.420703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fd33c6e67b443eaae5eb01740ad3ef'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.428441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e728bf0-f8e0-427e-94b1-5ae8a76e9f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fd33c6e67b443eaae5eb01740ad3ef'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.447272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 951/1895] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:02 2022] DELETE /identity/v3/users/75fd33c6e67b443eaae5eb01740ad3ef => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:02.450795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:02.451091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:02.451371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:02.472951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:02.474211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:02.514219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] The token cache is being invalidate because project d6d08f16b3644f7098b56f941e1e1f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:02.514219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.514219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.514765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 945/1896] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:02 2022] DELETE /identity/v3/projects/d6d08f16b3644f7098b56f941e1e1f75 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:02.521292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:02.523753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:02.582078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 952/1897] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:02.598805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:02.603351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:02.619361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551b99f-ec40-4ac8-9642-35fd3d31e47f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:02.628322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:02.628322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:02.628322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:02.628322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] PATH_INFO: `/v3/users/1e123d20f9764387893ae758c5b91591` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:02.628697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e123d20f9764387893ae758c5b91591)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:02.630568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:02.710671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d414d0c-4068-4a42-aff9-311272461a49 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:02.716213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:02.716213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:02.716213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:02.716213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:02.726194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:02.727817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:02.740004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 953/1898] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:02.821399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e123d20f9764387893ae758c5b91591'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.834783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e123d20f9764387893ae758c5b91591'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.835783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e123d20f9764387893ae758c5b91591'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.843846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e123d20f9764387893ae758c5b91591'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.844798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e123d20f9764387893ae758c5b91591'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:02.924571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 946/1899] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:02 2022] DELETE /identity/v3/users/1e123d20f9764387893ae758c5b91591 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:03.279756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:03.281265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:03.301941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb60e71-7df4-4cbd-b533-99f3b86c720b service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:03.428183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:03.430127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:03.430424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:03.430897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] PATH_INFO: `/v3/projects/449990adef6846e5934ca07f07d34842` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:03.439394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=449990adef6846e5934ca07f07d34842)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:03.446342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:03.613362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:03.613892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:03.635814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449990adef6846e5934ca07f07d34842', 'request_id': 'req-1af00fa5-6d86-406a-a632-4bc63ec2ff36'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.656636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2551b22-cc6b-4d03-a6df-dd424b3ba4dc admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:03.713165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449990adef6846e5934ca07f07d34842', 'request_id': 'req-1af00fa5-6d86-406a-a632-4bc63ec2ff36'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.721137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449990adef6846e5934ca07f07d34842', 'request_id': 'req-1af00fa5-6d86-406a-a632-4bc63ec2ff36'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.728103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:03.729211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:03.729785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:03.730281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] PATH_INFO: `/v3/projects/f35e2ba57f72453d9f6c4f0b716b6d6c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:03.731730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35e2ba57f72453d9f6c4f0b716b6d6c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:03.734345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:03.756413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] The token cache is being invalidate because project 449990adef6846e5934ca07f07d34842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:03.757084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.758187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.766671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 954/1900] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:03 2022] DELETE /identity/v3/projects/449990adef6846e5934ca07f07d34842 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:03.768439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:03.770960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:03.802588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af00fa5-6d86-406a-a632-4bc63ec2ff36 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:03.809601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:03.810860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:03.811357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:03.811963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] PATH_INFO: `/v3/users/8952acfc7fce4001b038a001fcf434ba` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:03.814010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8952acfc7fce4001b038a001fcf434ba)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:03.816332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:03.945619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35e2ba57f72453d9f6c4f0b716b6d6c', 'request_id': 'req-17439ab4-1492-4405-807f-464531ccf230'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.951480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35e2ba57f72453d9f6c4f0b716b6d6c', 'request_id': 'req-17439ab4-1492-4405-807f-464531ccf230'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:03.959506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35e2ba57f72453d9f6c4f0b716b6d6c', 'request_id': 'req-17439ab4-1492-4405-807f-464531ccf230'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.061261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] The token cache is being invalidate because project f35e2ba57f72453d9f6c4f0b716b6d6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:04.061515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.062150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-17439ab4-1492-4405-807f-464531ccf230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.063713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 947/1901] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:03 2022] DELETE /identity/v3/projects/f35e2ba57f72453d9f6c4f0b716b6d6c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:04.069277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8ebe-6ce0-4fab-ac16-50f4069cd06a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.069575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8ebe-6ce0-4fab-ac16-50f4069cd06a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.070467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8ebe-6ce0-4fab-ac16-50f4069cd06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.088744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8952acfc7fce4001b038a001fcf434ba'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.089769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8952acfc7fce4001b038a001fcf434ba'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.090011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ca8c8ebe-6ce0-4fab-ac16-50f4069cd06a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:04.090642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8952acfc7fce4001b038a001fcf434ba'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.091605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ca8c8ebe-6ce0-4fab-ac16-50f4069cd06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:04.151931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 948/1902] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:04.159913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.160203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.160481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.180112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:04.181334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:04.191552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 949/1903] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:04.198030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.204884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952508b-fb1f-4d72-ba08-f6bb0d3dfede None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.209509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8952acfc7fce4001b038a001fcf434ba'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.217437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.218162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.218580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.218823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.219516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:04.219825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.221562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:04.223235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8952acfc7fce4001b038a001fcf434ba'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.239614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 950/1904] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:11:04.240823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.253368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 955/1905] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:03 2022] DELETE /identity/v3/users/8952acfc7fce4001b038a001fcf434ba => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:04.257632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc57a-0dee-4861-8287-19f3197f5e04 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.325440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.326233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.326744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.327026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.327776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.336563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:04.449503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 951/1906] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:04 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:04.458795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.481770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14964b9d-634e-43e8-b8c1-c35e43140187 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.579309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e816a-530b-4618-9329-010116950db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.580600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e816a-530b-4618-9329-010116950db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.581604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e816a-530b-4618-9329-010116950db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.581887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e816a-530b-4618-9329-010116950db2 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.582912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e816a-530b-4618-9329-010116950db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.585214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e816a-530b-4618-9329-010116950db2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:04.683705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 956/1907] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:04 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:04.686894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.713238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e816a-530b-4618-9329-010116950db2 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.717757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-757e816a-530b-4618-9329-010116950db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:04.724146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb147332-f0d4-4a05-85a1-ebacef76387d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.742420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.747326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.747326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.747326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.747326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.753884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:04.757669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e816a-530b-4618-9329-010116950db2 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.764535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.765772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.766314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.767210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] PATH_INFO: `/v3/projects/74807a98bd504c8288b47f555d46aacd` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.769802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74807a98bd504c8288b47f555d46aacd)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.772387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:04.784105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 952/1908] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:04.789428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.807351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389bc46-542e-43cf-beb6-da77f7b93ddd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.812629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.813463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.813843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.814273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.815111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.817988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:04.848752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 953/1909] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:04.849680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:04.874710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e7f74-0302-418d-b07f-ee967a1cefed admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:04.881173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74807a98bd504c8288b47f555d46aacd', 'request_id': 'req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:04.951630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe559016-7be5-407d-9826-129c0e4c31f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:04.952884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559016-7be5-407d-9826-129c0e4c31f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:04.953336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559016-7be5-407d-9826-129c0e4c31f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:04.953832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559016-7be5-407d-9826-129c0e4c31f6 admin admin] PATH_INFO: `/v3/projects/ef3f9a11b84a49e2912a33340af2a22a/users/12a1384bb0b24edcafd8de057014e106/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:04.971099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559016-7be5-407d-9826-129c0e4c31f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3f9a11b84a49e2912a33340af2a22a, user_id=12a1384bb0b24edcafd8de057014e106, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:04.974347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559016-7be5-407d-9826-129c0e4c31f6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.046272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74807a98bd504c8288b47f555d46aacd', 'request_id': 'req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.058403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74807a98bd504c8288b47f555d46aacd', 'request_id': 'req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.092693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 954/1910] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:04 2022] PUT /identity/v3/projects/ef3f9a11b84a49e2912a33340af2a22a/users/12a1384bb0b24edcafd8de057014e106/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:05.102983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] The token cache is being invalidate because project 74807a98bd504c8288b47f555d46aacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:05.103459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.104369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e22c4eb1-86e2-4cd1-bdfb-a6e0746a5242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.118139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a470-3038-4a2a-8da4-3db96a7b9b8f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.118139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a470-3038-4a2a-8da4-3db96a7b9b8f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.118139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a470-3038-4a2a-8da4-3db96a7b9b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.118871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 957/1911] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:04 2022] DELETE /identity/v3/projects/74807a98bd504c8288b47f555d46aacd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:05.125812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.126375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.126807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.172892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0025a470-3038-4a2a-8da4-3db96a7b9b8f None None] MFA Rules not processed for user `12a1384bb0b24edcafd8de057014e106`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:05.175118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0025a470-3038-4a2a-8da4-3db96a7b9b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.175988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:05.178983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.323441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 958/1912] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:05.324542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.326455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.341710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef631ed-643d-4683-a8cc-d79800d4499b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.348933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.349790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.367798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.367798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] PATH_INFO: `/v3/users/7f56e77ef09d412aa3fb3baead2948d2` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.367798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f56e77ef09d412aa3fb3baead2948d2)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.367798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.368198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 955/1913] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:05.368198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.368198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.368198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.411663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:05.413843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.425720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 956/1914] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:05.426595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.432142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.506077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf970c5-336f-4186-9b8b-201a6e6da218 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.510558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.511376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.511762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.512434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.522169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.526276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.536345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 957/1915] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:05.539769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.557122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6e258-5b4a-43f0-8af5-8cacf8cd36bc service glance] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.562713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.563380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.563666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.563940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.564665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:05.564969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.567196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.573994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f56e77ef09d412aa3fb3baead2948d2'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.575062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f56e77ef09d412aa3fb3baead2948d2'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.577152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f56e77ef09d412aa3fb3baead2948d2'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.585842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 958/1916] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:05.587840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.590096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.603311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9680f8-0e6f-4870-b95a-7df703ecc5b2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.609618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.610367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.610630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.610894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.611570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.614189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.649567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f56e77ef09d412aa3fb3baead2948d2'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.658020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dbd4dff8-6c7c-4331-a4ab-5333f412a9bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f56e77ef09d412aa3fb3baead2948d2'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:05.683692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 959/1917] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:05 2022] DELETE /identity/v3/users/7f56e77ef09d412aa3fb3baead2948d2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:05.688104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.688891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.689312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.708712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:05.710191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.738728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 959/1918] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:05 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:05.743173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.795943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 960/1919] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:05.803146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.804825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:05.836881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11b3e6-d704-4c5b-81ce-f8447b27443b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.844743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.845590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.846000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.846423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.848138 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.851189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.888861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9744b-6655-4ab5-8546-75ec72cf5fef None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.916043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 960/1920] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:05 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:05.920780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.932007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f140-4e02-41e9-bcab-c6b6ab63b9c1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.937364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.937982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.938281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.938569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.939466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.941030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.949498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.951059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.951059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.951251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.952284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 961/1921] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:05.957100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:05.966593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.968052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.969040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4dec8-89fa-4396-ba1d-9a6c8133345c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:05.976022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfebbe0-7ca5-426d-be3d-955b1316f9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:05.976755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfebbe0-7ca5-426d-be3d-955b1316f9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:05.977037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfebbe0-7ca5-426d-be3d-955b1316f9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:05.977307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfebbe0-7ca5-426d-be3d-955b1316f9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:05.978063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfebbe0-7ca5-426d-be3d-955b1316f9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:05.979118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 961/1922] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:05.979730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfebbe0-7ca5-426d-be3d-955b1316f9ef admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:05.990288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 962/1923] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:05.995079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.007206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa49d66-77a1-4326-8f26-1646d7b4f2a5 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.012530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.013537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.013826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.014163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] PATH_INFO: `/v3/projects/5af87333eec244b9875524d54a5d3e76/users/d0069e1f1cdb412caa779b8e16f330dc/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.038408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af87333eec244b9875524d54a5d3e76, user_id=d0069e1f1cdb412caa779b8e16f330dc, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.038408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.107276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 962/1924] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:05 2022] PUT /identity/v3/projects/5af87333eec244b9875524d54a5d3e76/users/d0069e1f1cdb412caa779b8e16f330dc/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:06.118608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.118900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.119181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.170077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] MFA Rules not processed for user `d0069e1f1cdb412caa779b8e16f330dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:06.171404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:06.262004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 963/1925] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:06.266543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.340850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ace990-b7ed-4482-ba1f-67f46182e824 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.352968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.352968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.352968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.352968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.353574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.355678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.472710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.474311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:06.480609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 963/1926] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:06 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:06.485103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.503612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff59ad-ba02-4c88-9783-affe877ccff7 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.586951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.587833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.588116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.588713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] PATH_INFO: `/v3/projects/a9e9e8beec5640879b2eb56517b6ee6e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.589979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e9e8beec5640879b2eb56517b6ee6e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.591942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.649005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fcd8b9-3072-4132-a336-2e927da2eaab admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.658708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.660270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.660627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.660971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.661900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.664496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.712395 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e9e8beec5640879b2eb56517b6ee6e', 'request_id': 'req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:06.718119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e9e8beec5640879b2eb56517b6ee6e', 'request_id': 'req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:06.721089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 964/1927] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:06 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:06.722656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.727919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e9e8beec5640879b2eb56517b6ee6e', 'request_id': 'req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:06.732542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1359-a828-4dd1-b8e7-645b7d4d834b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.788370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.789046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.789333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.789662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.790450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.792011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.792164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] The token cache is being invalidate because project a9e9e8beec5640879b2eb56517b6ee6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:06.792656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:06.793011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:06.794686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 964/1928] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:06 2022] DELETE /identity/v3/projects/a9e9e8beec5640879b2eb56517b6ee6e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:06.798496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.799865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:06.805678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 965/1929] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:06.809610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:06.811381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:06.812830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded13aa-d2fa-416c-ad87-7161fc5a1fa2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.818966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.819854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.820299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.820717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] PATH_INFO: `/v3/users/2f559688abba4a69b55e2dd6e1ad6e8a` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.825595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f82729-b9fe-44e3-883e-4016a70d6595 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:06.827399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f559688abba4a69b55e2dd6e1ad6e8a)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.827641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.831224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:06.832449 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:06.832813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:06.833162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] PATH_INFO: `/v3/projects/70cc62ef196c41fe80f7caf93181c08f/users/782d8648d9a34ef789edf477a8034d8a/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:06.851379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc62ef196c41fe80f7caf93181c08f, user_id=782d8648d9a34ef789edf477a8034d8a, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:06.854536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:06.947008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 966/1930] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:06 2022] PUT /identity/v3/projects/70cc62ef196c41fe80f7caf93181c08f/users/782d8648d9a34ef789edf477a8034d8a/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:06.950908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:07.010021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189c7f0-2fa5-427c-ad37-2aa9f12c4462 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:07.014706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:07.015366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:07.015655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:07.015936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:07.016661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:07.018283 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:07.028251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 967/1931] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:07.032244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:07.035589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f559688abba4a69b55e2dd6e1ad6e8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.042706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e9870-e164-47f1-867a-7468df3496f6 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:07.047287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70ad35-8b43-4db1-af5a-95ee9400a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:07.047940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f559688abba4a69b55e2dd6e1ad6e8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.048200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70ad35-8b43-4db1-af5a-95ee9400a44c admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:07.048482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70ad35-8b43-4db1-af5a-95ee9400a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:07.048638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f559688abba4a69b55e2dd6e1ad6e8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.048754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70ad35-8b43-4db1-af5a-95ee9400a44c admin admin] PATH_INFO: `/v3/projects/70cc62ef196c41fe80f7caf93181c08f/users/782d8648d9a34ef789edf477a8034d8a/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:07.051414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70ad35-8b43-4db1-af5a-95ee9400a44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc62ef196c41fe80f7caf93181c08f, user_id=782d8648d9a34ef789edf477a8034d8a, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:07.054032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70ad35-8b43-4db1-af5a-95ee9400a44c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:07.056097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f559688abba4a69b55e2dd6e1ad6e8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.056743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f559688abba4a69b55e2dd6e1ad6e8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.064046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 968/1932] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:07 2022] PUT /identity/v3/projects/70cc62ef196c41fe80f7caf93181c08f/users/782d8648d9a34ef789edf477a8034d8a/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:07.074436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:07.074729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:07.075010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:07.101102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] MFA Rules not processed for user `782d8648d9a34ef789edf477a8034d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:07.102339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:07.129209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 965/1933] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:06 2022] DELETE /identity/v3/users/2f559688abba4a69b55e2dd6e1ad6e8a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:07.168873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 969/1934] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:07.180563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:07.182094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:07.238645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc289f-ac43-42e4-93c8-5bcc46e18215 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:07.242266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9dc59-2873-4d11-bb0c-ebacd872df86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:07.242917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9dc59-2873-4d11-bb0c-ebacd872df86 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:07.243204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9dc59-2873-4d11-bb0c-ebacd872df86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:07.243479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9dc59-2873-4d11-bb0c-ebacd872df86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:07.301925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9dc59-2873-4d11-bb0c-ebacd872df86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:07.303465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9dc59-2873-4d11-bb0c-ebacd872df86 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:07.312998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 966/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:07.564783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:07.566390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:07.641344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b6387-7280-40ff-b9ff-962cfdcdce3a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:07.698839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:07.699701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:07.699988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:07.700264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] PATH_INFO: `/v3/projects/8f8e5c53c42343c4ba37810f5a71ea1e` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:07.701451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8e5c53c42343c4ba37810f5a71ea1e)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:07.703392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:07.832127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8e5c53c42343c4ba37810f5a71ea1e', 'request_id': 'req-9c5fe69d-3469-487f-833f-46221396637f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.917643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8e5c53c42343c4ba37810f5a71ea1e', 'request_id': 'req-9c5fe69d-3469-487f-833f-46221396637f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.923946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8e5c53c42343c4ba37810f5a71ea1e', 'request_id': 'req-9c5fe69d-3469-487f-833f-46221396637f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.935619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] The token cache is being invalidate because project 8f8e5c53c42343c4ba37810f5a71ea1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:07.935983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.936800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9c5fe69d-3469-487f-833f-46221396637f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:07.938454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 970/1936] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:07 2022] DELETE /identity/v3/projects/8f8e5c53c42343c4ba37810f5a71ea1e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:07.943517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:07.944025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:07.944150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:07.961536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:07.962768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:08.021855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 967/1937] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:08.029616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.029910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.030238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.049026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:08.050793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:08.058673 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 971/1938] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:08.062932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.073102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50a88-25d5-4726-8910-32ac3482fe17 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.077992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.080173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.080173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.080173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.080173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:08.080500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.081959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.095381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 968/1939] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:08.099536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.109514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36999e7b-abf8-474f-8c10-463cf13b598b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.115066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.115885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.115999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.116274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.117069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.119255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.212329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 972/1940] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:08 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:08.216919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.227495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e684c-c19a-4da7-a832-46532ccc5ad6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.300945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.301749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.302113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.302426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.303221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.306044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.382562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 969/1941] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:08 2022] POST /identity/v3/users => generated 282 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:08.393150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.406062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ceceb8-b5bb-4a42-9336-9533952ba69b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.410995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.411678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.411964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.412241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.413384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.415102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.426695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 973/1942] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:08.430730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.443584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464530ed-5c5b-4a0b-aa2a-f9af3933f1af admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.450118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316583f-2daa-48ff-a9e3-4c51980c0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.450724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316583f-2daa-48ff-a9e3-4c51980c0702 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.451085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316583f-2daa-48ff-a9e3-4c51980c0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.451424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316583f-2daa-48ff-a9e3-4c51980c0702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.452256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316583f-2daa-48ff-a9e3-4c51980c0702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.454160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316583f-2daa-48ff-a9e3-4c51980c0702 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.465753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 970/1943] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:08.471171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.482734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb1b0-d0ce-4d93-b2a1-2806d25b8155 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.491112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.492150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.492525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.492896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] PATH_INFO: `/v3/projects/200cb4b0a2b24affa9d3af19d3b77086/users/acb0383f78d1430791949d01e7248805/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.514240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] RBAC: Authorizing `identity:create_grant(project_id=200cb4b0a2b24affa9d3af19d3b77086, user_id=acb0383f78d1430791949d01e7248805, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.517374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.615542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 974/1944] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:08 2022] PUT /identity/v3/projects/200cb4b0a2b24affa9d3af19d3b77086/users/acb0383f78d1430791949d01e7248805/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:08.626912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.627277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.627560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.661251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] MFA Rules not processed for user `acb0383f78d1430791949d01e7248805`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:08.662911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:08.737665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 971/1945] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:08.738563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.813475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca2de4-cdcd-4205-96f5-69e7002143df admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.816797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.817705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.818103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.818390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.819123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.821157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:08.897646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 975/1946] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:08 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:08.902270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:08.914450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de95f4-f7d5-4bb5-9d6f-9a89b38a3756 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:08.985780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:08.988743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:08.988743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:08.988743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:08.988743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:08.990566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:09.101615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 972/1947] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:08 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:09.105635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:09.116493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9ecc-68a8-4d01-9435-9b851bcf6f46 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:09.121335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:09.122079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.122357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.122632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:09.123369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:09.124982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:09.136102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 976/1948] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:09.140429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:09.150495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a50f1-e148-4277-9881-341b0f557386 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:09.155199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:09.156078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.156411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.159550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] PATH_INFO: `/v3/projects/0471f9b425e44e118df61966e1f216ed/users/787df98133c34deb9552f29e94c062aa/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:09.174080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0471f9b425e44e118df61966e1f216ed, user_id=787df98133c34deb9552f29e94c062aa, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:09.177557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:09.256318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 973/1949] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:09 2022] PUT /identity/v3/projects/0471f9b425e44e118df61966e1f216ed/users/787df98133c34deb9552f29e94c062aa/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:09.260374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:09.270780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68b956d-9a9b-452f-bb66-29139ff39082 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:09.338741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac32bb9-e7cd-4b1b-bed6-3aee9fabf7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:09.339484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32bb9-e7cd-4b1b-bed6-3aee9fabf7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.339709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32bb9-e7cd-4b1b-bed6-3aee9fabf7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.339983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac32bb9-e7cd-4b1b-bed6-3aee9fabf7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:09.340739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac32bb9-e7cd-4b1b-bed6-3aee9fabf7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:09.342379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac32bb9-e7cd-4b1b-bed6-3aee9fabf7a4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:09.354713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 977/1950] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:09.360529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:09.371695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8b029-40a1-4361-b5f6-d9e040f239dd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:09.378324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:09.379310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.379612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.379948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] PATH_INFO: `/v3/projects/0471f9b425e44e118df61966e1f216ed/users/787df98133c34deb9552f29e94c062aa/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:09.392054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0471f9b425e44e118df61966e1f216ed, user_id=787df98133c34deb9552f29e94c062aa, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:09.392054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:09.401648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 974/1951] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:09 2022] PUT /identity/v3/projects/0471f9b425e44e118df61966e1f216ed/users/787df98133c34deb9552f29e94c062aa/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:09.413111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.413407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.413801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:09.459842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] MFA Rules not processed for user `787df98133c34deb9552f29e94c062aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:09.461265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:09.537767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 978/1952] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:09.549854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:09.552026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:09.620376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7558f64-9254-42f6-b826-f49307fa3947 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:09.624132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:09.624785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.625099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.625519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:09.637754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:09.639405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:09.650780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 975/1953] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:09.908407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:09.911036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:09.925287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513417-cd08-42a9-9de5-86b0449b21eb None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:09.930597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192660ce-e9a6-43f2-ab77-30bbff175903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:09.931441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192660ce-e9a6-43f2-ab77-30bbff175903 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:09.931749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192660ce-e9a6-43f2-ab77-30bbff175903 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:09.932046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192660ce-e9a6-43f2-ab77-30bbff175903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:10.013918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192660ce-e9a6-43f2-ab77-30bbff175903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:10.015544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192660ce-e9a6-43f2-ab77-30bbff175903 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:10.045649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 979/1954] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:09 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:11.089058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:11.090626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:11.161052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f9026-7653-4cb5-83f1-7c12efa3a808 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:11.165869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:11.166812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:11.167175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:11.167407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] PATH_INFO: `/v3/users/d0069e1f1cdb412caa779b8e16f330dc` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:11.168866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0069e1f1cdb412caa779b8e16f330dc)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:11.171049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:11.343080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0069e1f1cdb412caa779b8e16f330dc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:11.355133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0069e1f1cdb412caa779b8e16f330dc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:11.355950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0069e1f1cdb412caa779b8e16f330dc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:11.362710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0069e1f1cdb412caa779b8e16f330dc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:11.363502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0069e1f1cdb412caa779b8e16f330dc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:11.428431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 976/1955] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:11 2022] DELETE /identity/v3/users/d0069e1f1cdb412caa779b8e16f330dc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:11.433477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:11.434110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:11.434110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:11.456971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:11.458220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:11.520065 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 980/1956] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:11.530243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:11.531741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:11.591641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b466d9-e2e1-4946-8fb3-6882198a085c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:11.595829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:11.596508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:11.596796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:11.597090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:11.606831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:11.608298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:11.618138 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 977/1957] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:12.060949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:12.062775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:12.077175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665f8e5-62f9-4375-8082-58c1d467b08c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:12.089556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:12.090502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:12.090788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:12.091061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] PATH_INFO: `/v3/projects/5af87333eec244b9875524d54a5d3e76` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:12.092404 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af87333eec244b9875524d54a5d3e76)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:12.094432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:12.248529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af87333eec244b9875524d54a5d3e76', 'request_id': 'req-86a56667-6886-499e-9e9c-ddfbc89485b5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.301774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af87333eec244b9875524d54a5d3e76', 'request_id': 'req-86a56667-6886-499e-9e9c-ddfbc89485b5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.314927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af87333eec244b9875524d54a5d3e76', 'request_id': 'req-86a56667-6886-499e-9e9c-ddfbc89485b5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.330214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] The token cache is being invalidate because project 5af87333eec244b9875524d54a5d3e76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:12.330571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.332041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.335103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 981/1958] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:12 2022] DELETE /identity/v3/projects/5af87333eec244b9875524d54a5d3e76 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:12.339447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:12.353499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac277a-ec91-41d8-a1d6-e89920565a68 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:12.416777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:12.418026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:12.418384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:12.418732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] PATH_INFO: `/v3/users/782d8648d9a34ef789edf477a8034d8a` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:12.420183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=782d8648d9a34ef789edf477a8034d8a)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:12.422294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:12.662846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782d8648d9a34ef789edf477a8034d8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.674758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782d8648d9a34ef789edf477a8034d8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.675513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782d8648d9a34ef789edf477a8034d8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.683123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782d8648d9a34ef789edf477a8034d8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.683874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782d8648d9a34ef789edf477a8034d8a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:12.788317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 978/1959] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:12 2022] DELETE /identity/v3/users/782d8648d9a34ef789edf477a8034d8a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:13.221802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.223315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.236748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a56667-6886-499e-9e9c-ddfbc89485b5 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:13.296344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:13.297287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.297572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.297850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] PATH_INFO: `/v3/projects/70cc62ef196c41fe80f7caf93181c08f` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.299070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cc62ef196c41fe80f7caf93181c08f)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:13.301498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:13.402350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cc62ef196c41fe80f7caf93181c08f', 'request_id': 'req-d799b218-9465-479e-a35f-09d8ea6bd8a5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.449599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cc62ef196c41fe80f7caf93181c08f', 'request_id': 'req-d799b218-9465-479e-a35f-09d8ea6bd8a5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.455119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.457677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.457754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cc62ef196c41fe80f7caf93181c08f', 'request_id': 'req-d799b218-9465-479e-a35f-09d8ea6bd8a5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.469165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] The token cache is being invalidate because project 70cc62ef196c41fe80f7caf93181c08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:13.469677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.470407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e13fa-0afb-4295-808f-ecea6771bc9c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:13.470720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d799b218-9465-479e-a35f-09d8ea6bd8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.472492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 982/1960] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:13 2022] DELETE /identity/v3/projects/70cc62ef196c41fe80f7caf93181c08f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:13.477247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24046-454d-4797-96db-1b02c6077e75 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.477737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24046-454d-4797-96db-1b02c6077e75 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.477920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab24046-454d-4797-96db-1b02c6077e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.496626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6ab24046-454d-4797-96db-1b02c6077e75 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:13.497907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6ab24046-454d-4797-96db-1b02c6077e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.533405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:13.534509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.534790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.535065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] PATH_INFO: `/v3/users/0465e535bf764a95a9cb8104a8f1bdcc` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.536388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0465e535bf764a95a9cb8104a8f1bdcc)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:13.538618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:13.564476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 983/1961] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:13.573269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.573269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.573460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.591289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:13.592505 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.604560 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 984/1962] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:13.605531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.615111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c40a8-5984-453a-b4be-e46cef924027 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:13.619830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:13.620504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.620793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.621100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.621847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:13.622185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:13.623781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:13.637244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 985/1963] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:13.639511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.649402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4df3c0-d779-4e77-9bde-70ccdd02c9ce admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:13.654770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:13.655470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.655786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.656068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.656778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:13.659470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:13.770203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 986/1964] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:13 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:13.770203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.775175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0465e535bf764a95a9cb8104a8f1bdcc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.790859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0465e535bf764a95a9cb8104a8f1bdcc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.791672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0465e535bf764a95a9cb8104a8f1bdcc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.798412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0465e535bf764a95a9cb8104a8f1bdcc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.799084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94842610-1b1b-4d4d-8632-d5cf2ecaf844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0465e535bf764a95a9cb8104a8f1bdcc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:13.834624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e69f35-ece7-448c-94c5-a7effea009e7 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:13.839442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:13.840157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.840559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.840823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.841540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:13.843655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:13.867262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 979/1965] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:13 2022] DELETE /identity/v3/users/0465e535bf764a95a9cb8104a8f1bdcc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:13.871593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.871947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.872291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.890462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:13.891697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.950915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 980/1966] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:13.960124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 987/1967] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:13 2022] POST /identity/v3/users => generated 296 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:13.961362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.962812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.963872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:13.965666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:13.977898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd388b1f-d79b-4ce0-9f8f-13954eb6e844 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:13.983184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:13.983845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:13.984169 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:13.984568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:13.985506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:13.997303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.008501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 988/1968] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:14.012386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.021745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af38ca9-60ba-4902-a9cf-1489a6b4fcb9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.021957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542cdaf-8ae1-411f-b59b-1b927fe55483 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.025866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b719321-52a3-46f2-b1da-906d7cdeafa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.026557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719321-52a3-46f2-b1da-906d7cdeafa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.026692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.026842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719321-52a3-46f2-b1da-906d7cdeafa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.027265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b719321-52a3-46f2-b1da-906d7cdeafa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.027350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.027615 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.027898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.028628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.030250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.036779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719321-52a3-46f2-b1da-906d7cdeafa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.038677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b719321-52a3-46f2-b1da-906d7cdeafa8 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.041465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 989/1969] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:14.044488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.049097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 981/1970] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:14.054739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb0e9f-8c24-489f-b9f9-bae7bd0928b2 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.059851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.060718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.061033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.061312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] PATH_INFO: `/v3/projects/7ff244833b0240e9ab2bba1e75fe41c3/users/6bf6a7fd8dc64171879a3b4f1489cc77/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.079028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff244833b0240e9ab2bba1e75fe41c3, user_id=6bf6a7fd8dc64171879a3b4f1489cc77, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.082594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.136086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 990/1971] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:14 2022] PUT /identity/v3/projects/7ff244833b0240e9ab2bba1e75fe41c3/users/6bf6a7fd8dc64171879a3b4f1489cc77/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:14.147813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.148187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.148472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.179568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] MFA Rules not processed for user `6bf6a7fd8dc64171879a3b4f1489cc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:14.180923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:14.258103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 982/1972] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:14.267647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.338407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d94f-e981-41b1-9c65-b7b53fa71bac admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.343461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.344295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.344966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.345199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.346952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.348707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.457688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 991/1973] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:14 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:14.457784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.466096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf18fff-9ae7-4d86-8f2a-7be768630907 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.484653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.486679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:14.554653 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.555541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.555820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.556161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.557089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.559537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.594408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7588e-3578-4c7c-acb4-3e8f46eaf4f5 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.604974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.606031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.606379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.606667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] PATH_INFO: `/v3/projects/764fcc43383b4b6d851076349834e4ee` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.607891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=764fcc43383b4b6d851076349834e4ee)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.609854 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.666647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 983/1974] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:14 2022] POST /identity/v3/users => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:14.670402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.679657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789041ad-6acd-4fb1-8498-0ce1ffc5a9c6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.684255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.684885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.685173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.685452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.686197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.687821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.698351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 984/1975] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:14.702272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.712349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e68f8-0169-4df0-a892-f10c3c7e6165 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.717045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.717892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.718212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.718492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] PATH_INFO: `/v3/projects/89a3c5a63b8c4ddb842faf5014407937/users/0f22c6b457e546edbf80612694ebb867/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.733362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a3c5a63b8c4ddb842faf5014407937, user_id=0f22c6b457e546edbf80612694ebb867, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.738568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.748094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764fcc43383b4b6d851076349834e4ee', 'request_id': 'req-39468571-e80d-4759-a4ec-fa817545bbda'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:14.816219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764fcc43383b4b6d851076349834e4ee', 'request_id': 'req-39468571-e80d-4759-a4ec-fa817545bbda'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:14.825290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 985/1976] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:14 2022] PUT /identity/v3/projects/89a3c5a63b8c4ddb842faf5014407937/users/0f22c6b457e546edbf80612694ebb867/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:14.825393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764fcc43383b4b6d851076349834e4ee', 'request_id': 'req-39468571-e80d-4759-a4ec-fa817545bbda'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:14.827485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.846535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] The token cache is being invalidate because project 764fcc43383b4b6d851076349834e4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:14.846837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:14.847557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-39468571-e80d-4759-a4ec-fa817545bbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:14.849739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 992/1977] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:14 2022] DELETE /identity/v3/projects/764fcc43383b4b6d851076349834e4ee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:14.856918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d0c1-42f6-44bd-ab1a-73ab1d0548c4 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.857275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d0c1-42f6-44bd-ab1a-73ab1d0548c4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.857561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9d0c1-42f6-44bd-ab1a-73ab1d0548c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.880277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-deb9d0c1-42f6-44bd-ab1a-73ab1d0548c4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:14.882088 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-deb9d0c1-42f6-44bd-ab1a-73ab1d0548c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:14.917093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72047fb0-b6e2-4459-b6ae-41a5113c49b4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.924842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.925911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.926376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.927061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.927911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.930508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.950225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 986/1978] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:14.954224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:14.957841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:14.967274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 993/1979] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:14.978956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.979215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.979495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.982411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3923-d37a-4380-b82c-6b8e61da23a8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:14.987460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57620a-d7a0-49ae-9261-7a6e1be5c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:14.988695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57620a-d7a0-49ae-9261-7a6e1be5c539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:14.988985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57620a-d7a0-49ae-9261-7a6e1be5c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:14.989264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57620a-d7a0-49ae-9261-7a6e1be5c539 admin admin] PATH_INFO: `/v3/projects/89a3c5a63b8c4ddb842faf5014407937/users/0f22c6b457e546edbf80612694ebb867/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:14.991767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57620a-d7a0-49ae-9261-7a6e1be5c539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a3c5a63b8c4ddb842faf5014407937, user_id=0f22c6b457e546edbf80612694ebb867, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:14.994534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57620a-d7a0-49ae-9261-7a6e1be5c539 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:14.999630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:15.001084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.006714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 987/1980] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:14 2022] PUT /identity/v3/projects/89a3c5a63b8c4ddb842faf5014407937/users/0f22c6b457e546edbf80612694ebb867/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:15.017076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.017446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.017800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.057033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] MFA Rules not processed for user `0f22c6b457e546edbf80612694ebb867`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:15.060936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.089379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 994/1981] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:15.093610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.103546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d909c9-35b9-4395-a925-915ae5a3a530 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.111811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.112672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.113056 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.113433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.114301 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:15.114731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.116490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.133757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 995/1982] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:15.138735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.149092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831941-6274-407e-b3cc-9db59fcbd3fb admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.149369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 988/1983] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:15.153876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.154556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.154833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.155107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.155844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.157821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.160764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.162326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.220709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e6e7ff-10ab-4161-b188-a766c8be631c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.224913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.225556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.225841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.226150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.234908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.236346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.246113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 989/1984] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:15.261381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 996/1985] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:15.265496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.275772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442af29e-695b-4da0-857e-b33701ba9448 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.296271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.298046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.332108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.332779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.333057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.333329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.334046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.335957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.356326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9240782-67cb-4b74-ab88-22aae0ea2799 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.358012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.358663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.358948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.359224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.360981 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.418292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.419714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.428920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 997/1986] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:15.446970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 990/1987] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:15 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:15.448532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.459540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e65c6-8f5a-4505-946d-f3e0bc93acb2 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.464520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.465293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.465696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.466013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.466876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.468621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.482192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 998/1988] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:15.483382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.495710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956c08f-d4b8-4eeb-a89e-b3a6cc374312 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.500877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20561c-3db8-4183-b178-440e0b93995b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.501543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20561c-3db8-4183-b178-440e0b93995b admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.501824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20561c-3db8-4183-b178-440e0b93995b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.502130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20561c-3db8-4183-b178-440e0b93995b admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.503415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20561c-3db8-4183-b178-440e0b93995b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.505002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20561c-3db8-4183-b178-440e0b93995b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.514695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 991/1989] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:15.518978 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.529035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476709a-d69a-4bf8-8380-a3f6edca79ab admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.542520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.543419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.543702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.544102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] PATH_INFO: `/v3/projects/9211b70dd81f45fa8abd2cfaf151e4d6/users/052eaf73262c40e38e14b440fd093738/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.561512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9211b70dd81f45fa8abd2cfaf151e4d6, user_id=052eaf73262c40e38e14b440fd093738, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.564377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.661340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 999/1990] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:15 2022] PUT /identity/v3/projects/9211b70dd81f45fa8abd2cfaf151e4d6/users/052eaf73262c40e38e14b440fd093738/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:15.666771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfad90-7c35-413f-8e4f-883e15e64f88 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.667067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfad90-7c35-413f-8e4f-883e15e64f88 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.667346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfad90-7c35-413f-8e4f-883e15e64f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.686140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-15dfad90-7c35-413f-8e4f-883e15e64f88 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:15.687360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-15dfad90-7c35-413f-8e4f-883e15e64f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.744075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 992/1991] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:15.753452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:15.755309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:15.811319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539352f-587a-4b8a-9fd3-49150a399294 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:15.815074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:15.815724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:15.816012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:15.816294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:15.825409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:15.826911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:15.837262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1000/1992] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:21.921565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:21.922053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:21.922191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:21.952279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] MFA Rules not processed for user `052eaf73262c40e38e14b440fd093738`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:21.953596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:22.033583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 993/1993] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:22.038433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.048585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81a99d-a9db-4228-9f2f-e8ef1e979790 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.055462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.056361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.056652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.056930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.057642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.059617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:22.164926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1001/1994] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:22 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:22.169000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.179487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18821bb8-07bc-4d71-b372-3884e2fef37b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.233267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.233941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.234258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.234540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.235234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.237762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:22.341047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 994/1995] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:22 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:22.344659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.355928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a1ea-a204-447d-8fa7-5cfd34caccf7 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.361282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.366018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.366018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.366018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.366018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.369028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:22.380655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1002/1996] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:22.384903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.395895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa754eb6-e27f-47eb-ab97-9e72c9e524cd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.415305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.416219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.416495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.416969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] PATH_INFO: `/v3/projects/2ed6d99350394bfebbdd164e5b97882a/users/2ad8cc53244d4b1b872395f11450184b/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.433053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed6d99350394bfebbdd164e5b97882a, user_id=2ad8cc53244d4b1b872395f11450184b, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.436000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:22.540903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.544081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 995/1997] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:22 2022] PUT /identity/v3/projects/2ed6d99350394bfebbdd164e5b97882a/users/2ad8cc53244d4b1b872395f11450184b/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:22.559976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57b54-03ff-4135-897f-6811dc4f6286 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.663184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.664007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.664302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.664589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.665395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.667074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:22.679212 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1003/1998] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:22.683269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.696449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d0acc-48ff-4452-b51d-8de853a13835 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.703120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878447e-6640-4df9-b633-ca21a20fecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.711604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878447e-6640-4df9-b633-ca21a20fecc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.711921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878447e-6640-4df9-b633-ca21a20fecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.718561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878447e-6640-4df9-b633-ca21a20fecc6 admin admin] PATH_INFO: `/v3/projects/2ed6d99350394bfebbdd164e5b97882a/users/2ad8cc53244d4b1b872395f11450184b/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.718561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878447e-6640-4df9-b633-ca21a20fecc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed6d99350394bfebbdd164e5b97882a, user_id=2ad8cc53244d4b1b872395f11450184b, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.718561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878447e-6640-4df9-b633-ca21a20fecc6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:22.731203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 996/1999] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:22 2022] PUT /identity/v3/projects/2ed6d99350394bfebbdd164e5b97882a/users/2ad8cc53244d4b1b872395f11450184b/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:22.903298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:22.916405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc22700-5f53-4ec3-8763-221e11562a2d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:22.984477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:22.985369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:22.985660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:22.985936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] PATH_INFO: `/v3/users/6bf6a7fd8dc64171879a3b4f1489cc77` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:22.987708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf6a7fd8dc64171879a3b4f1489cc77)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:22.989665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:23.189268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf6a7fd8dc64171879a3b4f1489cc77'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.190586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf6a7fd8dc64171879a3b4f1489cc77'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.191347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf6a7fd8dc64171879a3b4f1489cc77'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.272566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf6a7fd8dc64171879a3b4f1489cc77'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.293661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf6a7fd8dc64171879a3b4f1489cc77'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.315908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1004/2000] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:22 2022] DELETE /identity/v3/users/6bf6a7fd8dc64171879a3b4f1489cc77 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:23.320410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:23.320888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:23.321045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:23.342094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:23.343508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:23.411028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 997/2001] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:23.418837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:23.420318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:23.424812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:23.426292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:23.447579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d9031-0e8a-4378-b701-fec9c48ba4da admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:23.453654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:23.454660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:23.455595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:23.455948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] PATH_INFO: `/v3/users/acb0383f78d1430791949d01e7248805` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:23.457279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb0383f78d1430791949d01e7248805)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:23.459358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:23.508579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff895a-04df-4000-9f5f-ad88f8222cc4 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:23.512863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6e874-cbea-4948-bb3a-7c76ec66c0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:23.513523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6e874-cbea-4948-bb3a-7c76ec66c0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:23.513809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6e874-cbea-4948-bb3a-7c76ec66c0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:23.514128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6e874-cbea-4948-bb3a-7c76ec66c0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:23.526259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6e874-cbea-4948-bb3a-7c76ec66c0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:23.528477 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6e874-cbea-4948-bb3a-7c76ec66c0f9 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:23.540624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 998/2002] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:23.716149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb0383f78d1430791949d01e7248805'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.716982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb0383f78d1430791949d01e7248805'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.717709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb0383f78d1430791949d01e7248805'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.813502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb0383f78d1430791949d01e7248805'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.848463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb0383f78d1430791949d01e7248805'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:23.883601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1005/2003] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:23 2022] DELETE /identity/v3/users/acb0383f78d1430791949d01e7248805 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:23.888005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:23.888304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:23.889583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:23.909884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:23.911127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:23.986284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 999/2004] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:23.996443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:23.997900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:24.097311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684fe0a-5751-41ad-8108-1accf9f3b370 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:24.136596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:24.137931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:24.139480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:24.140995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:24.176781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:24.177980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:24.214626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1006/2005] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:24.904839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:24.907547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:24.932766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecacb5-e50f-4a3b-b4df-03009f745ffd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:24.944074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:24.950892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:24.951300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:24.951688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] PATH_INFO: `/v3/projects/200cb4b0a2b24affa9d3af19d3b77086` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:24.953938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200cb4b0a2b24affa9d3af19d3b77086)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:24.956101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:24.962389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:24.987221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:25.013739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe2c95-3465-4464-b931-e54ec2eb06ea service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:25.027396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:25.027766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:25.028060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:25.028344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] PATH_INFO: `/v3/projects/7ff244833b0240e9ab2bba1e75fe41c3` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:25.031351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff244833b0240e9ab2bba1e75fe41c3)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:25.034489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:25.169442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200cb4b0a2b24affa9d3af19d3b77086', 'request_id': 'req-2736c4f2-1a29-45c7-8712-17bfe20e7a34'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.174768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200cb4b0a2b24affa9d3af19d3b77086', 'request_id': 'req-2736c4f2-1a29-45c7-8712-17bfe20e7a34'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.180824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200cb4b0a2b24affa9d3af19d3b77086', 'request_id': 'req-2736c4f2-1a29-45c7-8712-17bfe20e7a34'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.216435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff244833b0240e9ab2bba1e75fe41c3', 'request_id': 'req-2513bdaa-d6b4-4b15-833b-08244719a4b3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.250109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] The token cache is being invalidate because project 200cb4b0a2b24affa9d3af19d3b77086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:25.250384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.253442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.255547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1000/2006] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:24 2022] DELETE /identity/v3/projects/200cb4b0a2b24affa9d3af19d3b77086 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:25.259281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:25.260812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:25.311430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff244833b0240e9ab2bba1e75fe41c3', 'request_id': 'req-2513bdaa-d6b4-4b15-833b-08244719a4b3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.320181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff244833b0240e9ab2bba1e75fe41c3', 'request_id': 'req-2513bdaa-d6b4-4b15-833b-08244719a4b3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.348082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c4f2-1a29-45c7-8712-17bfe20e7a34 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:25.356748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] The token cache is being invalidate because project 7ff244833b0240e9ab2bba1e75fe41c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:25.358606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.363426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.365873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1007/2007] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:24 2022] DELETE /identity/v3/projects/7ff244833b0240e9ab2bba1e75fe41c3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:25.369880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:25.374703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:25.461585 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:25.463000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:25.463328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:25.463618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] PATH_INFO: `/v3/users/787df98133c34deb9552f29e94c062aa` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:25.465267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=787df98133c34deb9552f29e94c062aa)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:25.467753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:25.483503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513bdaa-d6b4-4b15-833b-08244719a4b3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:25.488399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:25.489457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:25.490889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:25.491323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] PATH_INFO: `/v3/users/0f22c6b457e546edbf80612694ebb867` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:25.493702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f22c6b457e546edbf80612694ebb867)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:25.495697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:25.681944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '787df98133c34deb9552f29e94c062aa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.697546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '787df98133c34deb9552f29e94c062aa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.708087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '787df98133c34deb9552f29e94c062aa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.708087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '787df98133c34deb9552f29e94c062aa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.708087 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '787df98133c34deb9552f29e94c062aa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.715232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f22c6b457e546edbf80612694ebb867'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.716068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f22c6b457e546edbf80612694ebb867'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.716796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f22c6b457e546edbf80612694ebb867'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.793045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1001/2008] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:25 2022] DELETE /identity/v3/users/787df98133c34deb9552f29e94c062aa => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:25.880442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f22c6b457e546edbf80612694ebb867'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.891375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f22c6b457e546edbf80612694ebb867'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:25.921628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1008/2009] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:25 2022] DELETE /identity/v3/users/0f22c6b457e546edbf80612694ebb867 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:26.410211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:26.411754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:26.578213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb301e-24db-42f4-918d-4c5c5d418492 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:26.732125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:26.733457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:26.733739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:26.734045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] PATH_INFO: `/v3/projects/0471f9b425e44e118df61966e1f216ed` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:26.735300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0471f9b425e44e118df61966e1f216ed)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:26.737821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:26.795837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:26.798440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:26.814545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fc3fd-76be-45d1-8b97-ec0192dbfd5c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:26.826271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:26.827432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:26.830553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:26.831366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] PATH_INFO: `/v3/projects/89a3c5a63b8c4ddb842faf5014407937` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:26.841922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a3c5a63b8c4ddb842faf5014407937)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:26.841922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:26.894283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0471f9b425e44e118df61966e1f216ed', 'request_id': 'req-0c8b6954-c03d-4d77-ac40-0227c35644f5'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:26.901675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0471f9b425e44e118df61966e1f216ed', 'request_id': 'req-0c8b6954-c03d-4d77-ac40-0227c35644f5'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:26.924344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0471f9b425e44e118df61966e1f216ed', 'request_id': 'req-0c8b6954-c03d-4d77-ac40-0227c35644f5'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.051836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a3c5a63b8c4ddb842faf5014407937', 'request_id': 'req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.078082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] The token cache is being invalidate because project 0471f9b425e44e118df61966e1f216ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:27.084025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.084025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0c8b6954-c03d-4d77-ac40-0227c35644f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.084025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1002/2010] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:26 2022] DELETE /identity/v3/projects/0471f9b425e44e118df61966e1f216ed => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:27.086288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55711-d75e-4a19-8511-84f04e8cd062 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.086709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55711-d75e-4a19-8511-84f04e8cd062 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.087089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55711-d75e-4a19-8511-84f04e8cd062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.108521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6ae55711-d75e-4a19-8511-84f04e8cd062 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:27.109881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6ae55711-d75e-4a19-8511-84f04e8cd062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:27.159938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a3c5a63b8c4ddb842faf5014407937', 'request_id': 'req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.167512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a3c5a63b8c4ddb842faf5014407937', 'request_id': 'req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.181153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] The token cache is being invalidate because project 89a3c5a63b8c4ddb842faf5014407937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:27.181412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1003/2011] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:27.181930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.182713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a0c3f6a-7d8c-4ee0-8e92-30b6becebbcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:27.184529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1009/2012] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:26 2022] DELETE /identity/v3/projects/89a3c5a63b8c4ddb842faf5014407937 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:27.191818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.192342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.192839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.192985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a31f3-5928-403d-b6d9-9d94093474c8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.193252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a31f3-5928-403d-b6d9-9d94093474c8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.195268 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a31f3-5928-403d-b6d9-9d94093474c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.215126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7e1a31f3-5928-403d-b6d9-9d94093474c8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:27.217446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7e1a31f3-5928-403d-b6d9-9d94093474c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:27.227292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:27.229091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:27.243080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1004/2013] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:27.244062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1010/2014] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:27.244700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.246026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.246332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.246618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.264647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbae75a-274d-45e5-b66d-d75ddc512eab None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.270216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:27.271480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:27.271744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.272598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.273138 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.273555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.274462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:27.274908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.276873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.290745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1011/2015] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:27.295413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.304823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1005/2016] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:27.318572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.318900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdd13e-02f6-424e-a26e-1f964417a568 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.325759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d088b0e-e1bd-44e4-bf69-6145702667b7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.326028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.327206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.327502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.327787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.328596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:27.328908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.332997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.335756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.336402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.336686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.337450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.338185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.340451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.358568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1012/2017] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:27.360212 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.371446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eebee-0ef0-4e2f-9712-c089e23ebdf9 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.376331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.377026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.377309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.377585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.378487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.380528 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.429348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1006/2018] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:27.433463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.494079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1013/2019] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:27.498499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.508112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa628-278c-4c5e-829e-a0e2d0327ccf admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.594461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.595155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.595437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.595741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.596438 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.598399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.600875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a416-f863-4dab-b0a5-c1977358043a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.607014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.608151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.608782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.609219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.609998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.612992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.729351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1007/2020] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:27.729351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.744400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014669a1-970a-4c8e-a59d-3143c2e733e0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.774271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.775153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.776084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.776724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.777570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.781418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1014/2021] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:27 2022] POST /identity/v3/users => generated 282 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:27.789829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.791101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.810445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819293b-f7c6-42fc-adeb-282276afc530 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.813242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1008/2022] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:27.819873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.822152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.822851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.823136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.823552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.824295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.825893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.849956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1015/2023] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:27.854680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b1bbb-7848-4868-a6d4-f6c00f87bd69 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.856945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.870152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c55e-eac1-4749-a419-cc4cf846e517 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.872719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.876299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.876704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.877888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.878909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.881674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.886662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.887724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.888280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.888788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.889734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.896203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.915381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1009/2024] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:27.919268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.927419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1016/2025] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:27.935851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569bbf7-8630-4336-979f-16001b8a47af admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.936137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:27.943255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94e8ed-7ff5-4355-9393-1d37d882ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.944654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e8ed-7ff5-4355-9393-1d37d882ffe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.945269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e8ed-7ff5-4355-9393-1d37d882ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.945793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e8ed-7ff5-4355-9393-1d37d882ffe2 admin admin] PATH_INFO: `/v3/projects/bcefe7290a2d4796b398dfe7d3605e83/users/6981b77c5dfa4cb48e177d2974b88ba3/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.947801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028737f5-8fc8-4b71-ac26-4e2253c8508c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:27.956425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de99b-5e8f-447a-b4e2-6557d8e61bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:27.958327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de99b-5e8f-447a-b4e2-6557d8e61bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:27.958789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de99b-5e8f-447a-b4e2-6557d8e61bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:27.959305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de99b-5e8f-447a-b4e2-6557d8e61bb7 admin admin] PATH_INFO: `/v3/projects/9fe8ea8b6b94449f990f6600a13baded/users/81fe2e7092964d07b3ceea1869ab279e/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:27.982439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de99b-5e8f-447a-b4e2-6557d8e61bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe8ea8b6b94449f990f6600a13baded, user_id=81fe2e7092964d07b3ceea1869ab279e, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.986520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de99b-5e8f-447a-b4e2-6557d8e61bb7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:27.986837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94e8ed-7ff5-4355-9393-1d37d882ffe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcefe7290a2d4796b398dfe7d3605e83, user_id=6981b77c5dfa4cb48e177d2974b88ba3, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:27.991600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94e8ed-7ff5-4355-9393-1d37d882ffe2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:28.092123 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1010/2027] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:27 2022] PUT /identity/v3/projects/bcefe7290a2d4796b398dfe7d3605e83/users/6981b77c5dfa4cb48e177d2974b88ba3/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:28.098536 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1017/2027] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:27 2022] PUT /identity/v3/projects/9fe8ea8b6b94449f990f6600a13baded/users/81fe2e7092964d07b3ceea1869ab279e/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:28.105422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:28.106067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:28.106494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:28.107729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:28.108139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:28.109083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:28.161891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] MFA Rules not processed for user `6981b77c5dfa4cb48e177d2974b88ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:28.162988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] MFA Rules not processed for user `81fe2e7092964d07b3ceea1869ab279e`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:28.163376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:28.164690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:28.270000 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1018/2028] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:28.271783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:28.293275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1011/2029] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:28.294975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:28.413401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248ffc7-ce07-4ed1-b287-ce8fef2fe182 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:28.418567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:28.419239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:28.419532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:28.419813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:28.421385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:28.427186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:28.448902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeed21-3af5-408c-8d1a-ff5c74a358bb None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:28.457287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:28.649360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:28.649360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:28.649360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:28.649360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:28.649360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:28.858161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1012/2030] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:28 2022] POST /identity/v3/projects => generated 383 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:28.866001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1019/2031] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:28 2022] POST /identity/v3/projects => generated 367 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:28.871742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:28.873616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:28.988302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc7025-d8e6-47ef-9a69-aea77ec2fb7e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:28.988808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccdc02-6261-474c-ab7c-0536268df5b6 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:28.993303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:28.993472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:28.994007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:28.994137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:28.994295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:28.994429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:28.994558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:28.994708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:28.995283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:28.995395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:28.997207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:28.997353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.169140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1013/2032] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:28 2022] POST /identity/v3/users => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:29.170088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.172363 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1020/2033] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:28 2022] POST /identity/v3/users => generated 290 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:29.176486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.194354 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5e846-cb5d-4b1f-93e2-d328ef799bcd admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.196848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab6f5c-0f30-45a7-96eb-b65c66ecd840 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.206276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.207042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.207252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.207534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.208280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.214111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.214111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.214111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.214111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.214869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.214869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.215670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.243313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1021/2034] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:29.244408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.262752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1014/2035] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:29.262752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.268676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd7ede-ac6c-4e52-a1a2-01c2836ea146 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.272975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3300c13-c75f-466b-a41c-b97afac5a182 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.280882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.281774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.282087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.282369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] PATH_INFO: `/v3/projects/a5a94c2606044e1281bfd01398d8dc07/users/d763d6b0edb2403ab74df7ac5fd9e4f2/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.282975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.284831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.285269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.285688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] PATH_INFO: `/v3/projects/5836751a463d4317baf9bc8ce6dd065f/users/d714e6ff374246b69b506bb05c6a0dec/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.304139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a94c2606044e1281bfd01398d8dc07, user_id=d763d6b0edb2403ab74df7ac5fd9e4f2, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.305930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5836751a463d4317baf9bc8ce6dd065f, user_id=d714e6ff374246b69b506bb05c6a0dec, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.307931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.308902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.448447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1022/2036] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:29 2022] PUT /identity/v3/projects/a5a94c2606044e1281bfd01398d8dc07/users/d763d6b0edb2403ab74df7ac5fd9e4f2/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:29.452287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.476491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1015/2037] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:29 2022] PUT /identity/v3/projects/5836751a463d4317baf9bc8ce6dd065f/users/d714e6ff374246b69b506bb05c6a0dec/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:29.479036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.525442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643c7f6-385f-4e4e-a647-710538e36049 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.568478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba08ac-869d-4a1b-95a1-85ee7980d0ef admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.576750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.577832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.578301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.578592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.580557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.588586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.601763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1016/2038] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:29.603325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.604160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.604455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.605010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.605761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.605905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.607751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.619267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05dadb-7377-4621-aae2-dfc966b53d2d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.622829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1023/2039] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:29.626574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.629810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08b2c-a4ef-4199-be71-acc4ac89565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.630956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08b2c-a4ef-4199-be71-acc4ac89565c admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.631237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08b2c-a4ef-4199-be71-acc4ac89565c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.631794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08b2c-a4ef-4199-be71-acc4ac89565c admin admin] PATH_INFO: `/v3/projects/5836751a463d4317baf9bc8ce6dd065f/users/d714e6ff374246b69b506bb05c6a0dec/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.634110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08b2c-a4ef-4199-be71-acc4ac89565c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5836751a463d4317baf9bc8ce6dd065f, user_id=d714e6ff374246b69b506bb05c6a0dec, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.638830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08b2c-a4ef-4199-be71-acc4ac89565c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.642497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cab93-38d5-4b2f-910f-303687e922ba admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.658628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b8c23-62ac-4a49-b3c1-41c1ec54b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.658628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8c23-62ac-4a49-b3c1-41c1ec54b3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.658628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8c23-62ac-4a49-b3c1-41c1ec54b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.658628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b8c23-62ac-4a49-b3c1-41c1ec54b3b8 admin admin] PATH_INFO: `/v3/projects/a5a94c2606044e1281bfd01398d8dc07/users/d763d6b0edb2403ab74df7ac5fd9e4f2/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.659350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b8c23-62ac-4a49-b3c1-41c1ec54b3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a94c2606044e1281bfd01398d8dc07, user_id=d763d6b0edb2403ab74df7ac5fd9e4f2, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.659439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1017/2040] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:29 2022] PUT /identity/v3/projects/5836751a463d4317baf9bc8ce6dd065f/users/d714e6ff374246b69b506bb05c6a0dec/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:29.659535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b8c23-62ac-4a49-b3c1-41c1ec54b3b8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.667946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.668943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.669387 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.674230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1024/2041] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:29 2022] PUT /identity/v3/projects/a5a94c2606044e1281bfd01398d8dc07/users/d763d6b0edb2403ab74df7ac5fd9e4f2/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:29.685401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.689414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.689414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.720135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] MFA Rules not processed for user `d714e6ff374246b69b506bb05c6a0dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:29.721666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:29.737602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] MFA Rules not processed for user `d763d6b0edb2403ab74df7ac5fd9e4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:29.740228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:29.815150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1018/2042] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:29.826101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.827492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:29.844627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1025/2043] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:29.885936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a2488-fcfd-4232-8cf9-9312ec571b98 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.889780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.890280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.890559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.890831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.901200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.903255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:29.915099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1019/2044] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:29.938423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:29.949896 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1928f7a-f39d-451c-9bb5-6bb5cef05c90 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:29.960379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fea13-0d78-4631-a890-bdb2c667eb0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:29.961306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fea13-0d78-4631-a890-bdb2c667eb0a service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:29.961594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fea13-0d78-4631-a890-bdb2c667eb0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:29.961876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fea13-0d78-4631-a890-bdb2c667eb0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:29.991176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fea13-0d78-4631-a890-bdb2c667eb0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:29.993466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fea13-0d78-4631-a890-bdb2c667eb0a service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:30.005177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1026/2045] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:30.324067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:30.343767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717b55-847a-47e3-b9dd-101620dbf84f service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:30.352642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:30.353305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:30.353587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:30.353870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:30.405715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e8d6-873f-4fad-a3e8-199c8c510981 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:30.406181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e8d6-873f-4fad-a3e8-199c8c510981 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:30.407127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6e8d6-873f-4fad-a3e8-199c8c510981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:30.458864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:30.460340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:30.465738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-86f6e8d6-873f-4fad-a3e8-199c8c510981 None None] MFA Rules not processed for user `2ad8cc53244d4b1b872395f11450184b`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:30.467155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-86f6e8d6-873f-4fad-a3e8-199c8c510981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:30.486191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1020/2046] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:30.578272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1027/2047] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:30.591792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:30.593377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:30.656555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805aab-6969-4e72-83fc-f3557093466d service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:30.661121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:30.661792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:30.662109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:30.662389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:30.665474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:30.729231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:30.730783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:30.742631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1021/2048] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:31.039666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:31.040151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:31.040257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:31.059176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:31.060530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:31.118342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1028/2049] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:31.162912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:31.162912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:31.239167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63891c-0cb0-4d33-a914-c327580cea36 service glance] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:31.245225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:31.245772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:31.246083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:31.246365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:31.257139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:31.258810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:31.277277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1022/2050] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:11:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 26 14:11:31.335051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:31.349267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b242df-aaa1-492e-beca-132cb2da073d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:31.353453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef4491-9a85-4f2d-8ee4-e45a3784effb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:31.354416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4491-9a85-4f2d-8ee4-e45a3784effb service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:31.354900 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4491-9a85-4f2d-8ee4-e45a3784effb service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:31.355345 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef4491-9a85-4f2d-8ee4-e45a3784effb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:31.429487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4491-9a85-4f2d-8ee4-e45a3784effb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:31.430976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef4491-9a85-4f2d-8ee4-e45a3784effb service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:31.448709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1029/2051] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:35.202665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:35.266920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d7ac7-cdf3-4302-b36a-7fb28b90955b service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:35.272251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:35.273224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:35.273582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:35.273932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] PATH_INFO: `/v3/users/6981b77c5dfa4cb48e177d2974b88ba3` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:35.275228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6981b77c5dfa4cb48e177d2974b88ba3)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:35.277239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:35.617283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6981b77c5dfa4cb48e177d2974b88ba3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:35.653934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6981b77c5dfa4cb48e177d2974b88ba3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:35.654970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6981b77c5dfa4cb48e177d2974b88ba3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:35.675092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6981b77c5dfa4cb48e177d2974b88ba3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:35.675861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6981b77c5dfa4cb48e177d2974b88ba3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:35.788710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1023/2052] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:35 2022] DELETE /identity/v3/users/6981b77c5dfa4cb48e177d2974b88ba3 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:35.796732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:35.797388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:35.797388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:35.830563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:35.831957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:35.947285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1030/2053] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:35.951332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:35.953013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:36.047257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7d182-6699-4da9-9b3e-b219523e8455 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:36.051188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:36.051846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:36.052129 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:36.052405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:36.063321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:36.065369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:36.075982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1024/2054] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:36.146442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:36.147995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:36.176581 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b4231-687d-4c11-93b4-d3ea4dac6782 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:36.176785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:36.178153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:36.178646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:36.179399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] PATH_INFO: `/v3/users/6c8c139c181344259612105edd7d207d` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:36.180867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8c139c181344259612105edd7d207d)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:36.183143 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:36.410671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8c139c181344259612105edd7d207d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:36.414510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8c139c181344259612105edd7d207d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:36.414510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8c139c181344259612105edd7d207d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:36.506216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8c139c181344259612105edd7d207d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:36.520377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8c139c181344259612105edd7d207d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:36.572860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1031/2055] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:36 2022] DELETE /identity/v3/users/6c8c139c181344259612105edd7d207d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:36.853961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:36.855422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:36.891796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259138ed-37b9-48f5-b548-cfe38332a4b2 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:36.988768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:36.994600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:37.100022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:37.100809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.103557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.103843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] PATH_INFO: `/v3/projects/bcefe7290a2d4796b398dfe7d3605e83` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.105712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcefe7290a2d4796b398dfe7d3605e83)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:37.112250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:37.191765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a30cda-20ce-4b52-83db-dbf958764aab admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:37.197351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:37.198251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.198577 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.199057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] PATH_INFO: `/v3/projects/3d8a12641de140b68d42fda0758a97ef` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.200545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8a12641de140b68d42fda0758a97ef)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:37.202734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:37.284994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcefe7290a2d4796b398dfe7d3605e83', 'request_id': 'req-baccb90c-be07-4564-a7dd-40fc6b8762fe'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.293122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcefe7290a2d4796b398dfe7d3605e83', 'request_id': 'req-baccb90c-be07-4564-a7dd-40fc6b8762fe'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.303918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcefe7290a2d4796b398dfe7d3605e83', 'request_id': 'req-baccb90c-be07-4564-a7dd-40fc6b8762fe'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.378815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8a12641de140b68d42fda0758a97ef', 'request_id': 'req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.396038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] The token cache is being invalidate because project bcefe7290a2d4796b398dfe7d3605e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:37.396038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.396038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.396436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1025/2056] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:36 2022] DELETE /identity/v3/projects/bcefe7290a2d4796b398dfe7d3605e83 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:37.402252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:37.403698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:37.484677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8a12641de140b68d42fda0758a97ef', 'request_id': 'req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.494291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8a12641de140b68d42fda0758a97ef', 'request_id': 'req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.513249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] The token cache is being invalidate because project 3d8a12641de140b68d42fda0758a97ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:37.513642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.515229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6ebeee81-b93c-4fae-b87b-0e5675a2ed41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.524286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1032/2057] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:36 2022] DELETE /identity/v3/projects/3d8a12641de140b68d42fda0758a97ef => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:37.524378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb90c-be07-4564-a7dd-40fc6b8762fe admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:37.529618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641de37-5811-4ea1-8273-d37299cd80d4 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.530016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641de37-5811-4ea1-8273-d37299cd80d4 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.530383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641de37-5811-4ea1-8273-d37299cd80d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.573221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-4641de37-5811-4ea1-8273-d37299cd80d4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:37.575176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4641de37-5811-4ea1-8273-d37299cd80d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:37.628495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:37.630276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.632861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.632861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] PATH_INFO: `/v3/users/d714e6ff374246b69b506bb05c6a0dec` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.633388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d714e6ff374246b69b506bb05c6a0dec)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:37.636008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:37.667702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1033/2058] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:37.675386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.675878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.676165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.696980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:37.698476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:37.710125 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1034/2059] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:37.711943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:37.722309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305338f-39b8-47f5-a972-752c2513a1c0 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:37.727099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:37.727838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.728191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.728586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.729411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:37.729784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:37.731461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:37.747990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1035/2060] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:11:37.753406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:37.765711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c68359-0dfb-448c-ab5a-f069061f5277 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:37.771235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:37.771909 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.772342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.772662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.773448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:37.775299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:37.905278 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1036/2061] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:37.906419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:37.961352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd714e6ff374246b69b506bb05c6a0dec'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.977488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd714e6ff374246b69b506bb05c6a0dec'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.979066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd714e6ff374246b69b506bb05c6a0dec'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.987485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd714e6ff374246b69b506bb05c6a0dec'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.988518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd714e6ff374246b69b506bb05c6a0dec'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:37.989105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4685ff-9ee8-4997-83e0-39f67ec36571 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:37.996914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:37.997843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:37.998348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:37.998634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:37.999342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.001354 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.113033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1026/2062] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:37 2022] DELETE /identity/v3/users/d714e6ff374246b69b506bb05c6a0dec => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:38.151205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:38.152054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1037/2063] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:37 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:38.154103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:38.289854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8ef18-f5b7-4675-a815-f798f55e5e8b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:38.300608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:38.306178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.307243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.307755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.308734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.311781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.327944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1027/2064] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:38.330749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:38.344243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622172ae-623d-47fa-b050-21f258b5158c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:38.350169 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08e9fb-b2e9-4971-8bd3-e4cba324d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:38.351105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e9fb-b2e9-4971-8bd3-e4cba324d690 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.351859 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e9fb-b2e9-4971-8bd3-e4cba324d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.352303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e9fb-b2e9-4971-8bd3-e4cba324d690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.353526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08e9fb-b2e9-4971-8bd3-e4cba324d690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.355434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08e9fb-b2e9-4971-8bd3-e4cba324d690 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.367595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1038/2065] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:38.371794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:38.384517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14618728-5850-4ac6-9df7-c9b654a56abd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:38.389681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:38.390867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.391318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.392888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] PATH_INFO: `/v3/projects/852d3fc9b96d4019912cc7b5d7e2db73/users/797d50f3ba6244f4a62b3abfa24410d9/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.426617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] RBAC: Authorizing `identity:create_grant(project_id=852d3fc9b96d4019912cc7b5d7e2db73, user_id=797d50f3ba6244f4a62b3abfa24410d9, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.429424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.573272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1028/2066] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:38 2022] PUT /identity/v3/projects/852d3fc9b96d4019912cc7b5d7e2db73/users/797d50f3ba6244f4a62b3abfa24410d9/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:38.578728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.581282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.582486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.611729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:38.614998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:38.685777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:38.685777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:38.710089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1039/2067] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:38.716806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:38.719814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:38.800876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18f920-71b2-41c1-ba79-d077129fadee admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:38.805989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:38.807206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.807708 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.808133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] PATH_INFO: `/v3/projects/5836751a463d4317baf9bc8ce6dd065f` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.809758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5836751a463d4317baf9bc8ce6dd065f)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.811931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.842708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54a5b-0938-41ee-8d73-c930fb165b3e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:38.851431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:38.852238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.853410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.853698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.867085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.869325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.880534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1040/2068] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:38.881365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:38.882661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:38.912251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3b11-65bf-4b90-b130-555e541a7cef service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:38.919975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:38.921037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:38.921632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:38.922131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] PATH_INFO: `/v3/users/12a1384bb0b24edcafd8de057014e106` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:38.924209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a1384bb0b24edcafd8de057014e106)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:38.926172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:38.978940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5836751a463d4317baf9bc8ce6dd065f', 'request_id': 'req-2dcf7279-5813-4e52-8e4d-1761aca8fb34'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:38.986691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5836751a463d4317baf9bc8ce6dd065f', 'request_id': 'req-2dcf7279-5813-4e52-8e4d-1761aca8fb34'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:38.993388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5836751a463d4317baf9bc8ce6dd065f', 'request_id': 'req-2dcf7279-5813-4e52-8e4d-1761aca8fb34'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.081563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] The token cache is being invalidate because project 5836751a463d4317baf9bc8ce6dd065f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:39.081876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.086496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2dcf7279-5813-4e52-8e4d-1761aca8fb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.088658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1029/2069] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:38 2022] DELETE /identity/v3/projects/5836751a463d4317baf9bc8ce6dd065f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:39.093304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede6b2-065d-4ee1-8f1d-1c44f3fa3d19 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:39.093809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede6b2-065d-4ee1-8f1d-1c44f3fa3d19 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:39.095992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eede6b2-065d-4ee1-8f1d-1c44f3fa3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:39.137125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3eede6b2-065d-4ee1-8f1d-1c44f3fa3d19 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:39.139270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3eede6b2-065d-4ee1-8f1d-1c44f3fa3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:39.145702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a1384bb0b24edcafd8de057014e106'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.145702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a1384bb0b24edcafd8de057014e106'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.145702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a1384bb0b24edcafd8de057014e106'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.215110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a1384bb0b24edcafd8de057014e106'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.224030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a75cca7c-a8f7-42eb-954b-9b16b605d9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a1384bb0b24edcafd8de057014e106'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:39.246437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1041/2070] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:38 2022] DELETE /identity/v3/users/12a1384bb0b24edcafd8de057014e106 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:39.252517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:39.253086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:39.253371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:39.271936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1030/2071] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:39.277506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:39.279809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:39.280126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:39.280372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:39.282594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:39.302579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:39.304280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:39.463987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1031/2072] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:39.463987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:39.471084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1042/2073] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:39.505029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:39.505625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7ea83-03ae-45d8-a54d-b1181277e06d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:39.507260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:39.525803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:39.537757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:39.537757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:39.537757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:39.537757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:39.537757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:39.555006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:39.578964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1032/2074] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:11:39.581238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:39.592108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98444f33-d890-4738-904b-c1474c16541e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:39.599600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:39.600273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:39.600557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:39.600854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:39.601588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:39.603613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:39.624096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b38e1b-10a9-4326-9426-a5e62c008369 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:39.628629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:39.629290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:39.629596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:39.629877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:39.639391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:39.686427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:39.686427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1043/2075] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:40.190491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1033/2076] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:39 2022] POST /identity/v3/projects => generated 379 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:40.194511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:40.202825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:40.208166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5489f-fddb-47ca-99dd-704be82397e4 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:40.212164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:40.402665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:40.403992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:40.404485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:40.404975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:40.406397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:40.409625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:40.417678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc9b63-3cff-4e2f-af57-e8a5a389bd9f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:40.424214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:40.425103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:40.425388 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:40.425663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] PATH_INFO: `/v3/users/81fe2e7092964d07b3ceea1869ab279e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:40.427267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fe2e7092964d07b3ceea1869ab279e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:40.429216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:40.550357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1044/2077] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:40 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:40.555197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:40.578482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ddff8-f9c6-4b7b-ab20-159ae4eac1e1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:40.584810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:40.585738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:40.586253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:40.586762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:40.600366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:40.602178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:40.626991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1045/2078] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:40.626991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:40.628651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:40.652985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa157-c71d-4738-b8f4-5c55a2f85e65 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:40.669281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:40.670362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:40.670747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:40.671126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] PATH_INFO: `/v3/projects/ef3f9a11b84a49e2912a33340af2a22a` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:40.673146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3f9a11b84a49e2912a33340af2a22a)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:40.682131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:40.682649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fe2e7092964d07b3ceea1869ab279e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.703951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fe2e7092964d07b3ceea1869ab279e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.710397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fe2e7092964d07b3ceea1869ab279e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.716066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fe2e7092964d07b3ceea1869ab279e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.717360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fe2e7092964d07b3ceea1869ab279e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.793159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1034/2079] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:40 2022] DELETE /identity/v3/users/81fe2e7092964d07b3ceea1869ab279e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:40.793820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:40.796594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:40.844375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3f9a11b84a49e2912a33340af2a22a', 'request_id': 'req-1c61e3ba-312e-4bf3-9e51-078c00cb6985'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.908299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08632e4-94b7-42ee-ac4c-c24cace124c6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:40.945671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3f9a11b84a49e2912a33340af2a22a', 'request_id': 'req-1c61e3ba-312e-4bf3-9e51-078c00cb6985'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.953061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3f9a11b84a49e2912a33340af2a22a', 'request_id': 'req-1c61e3ba-312e-4bf3-9e51-078c00cb6985'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.987714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] The token cache is being invalidate because project ef3f9a11b84a49e2912a33340af2a22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:40.988128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.989841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1c61e3ba-312e-4bf3-9e51-078c00cb6985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:40.992194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1046/2080] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:40 2022] DELETE /identity/v3/projects/ef3f9a11b84a49e2912a33340af2a22a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:40.993472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3366-68bf-4c1e-8491-dbacd0b94225 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:40.994493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3366-68bf-4c1e-8491-dbacd0b94225 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:40.994902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3366-68bf-4c1e-8491-dbacd0b94225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.027390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-348e3366-68bf-4c1e-8491-dbacd0b94225 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:41.028765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-348e3366-68bf-4c1e-8491-dbacd0b94225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:41.061109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b073b3-33a1-4d95-9719-cb83bdb7a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.062536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b073b3-33a1-4d95-9719-cb83bdb7a225 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.063136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b073b3-33a1-4d95-9719-cb83bdb7a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.063475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b073b3-33a1-4d95-9719-cb83bdb7a225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.064399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b073b3-33a1-4d95-9719-cb83bdb7a225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.068726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b073b3-33a1-4d95-9719-cb83bdb7a225 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:41.080369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1035/2081] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:41.082019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.086682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.086682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.116290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:41.118317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:41.134521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1036/2082] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:41.135692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:41.139743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:41.160979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4342d-bb93-44a0-aa53-d619bbe76cc8 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:41.170268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.179428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.179730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.180011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] PATH_INFO: `/v3/projects/947bf499afe44dedbfa8cafb0177d9f6/users/e967e25022e44bd295f81e9f75a10405/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.185927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1047/2083] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:41.187579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.190457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.190864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.201588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] RBAC: Authorizing `identity:create_grant(project_id=947bf499afe44dedbfa8cafb0177d9f6, user_id=e967e25022e44bd295f81e9f75a10405, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.204610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:41.219837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:41.221801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:41.230650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1048/2084] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:41.231770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:41.233314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:41.294222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1037/2085] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:41 2022] PUT /identity/v3/projects/947bf499afe44dedbfa8cafb0177d9f6/users/e967e25022e44bd295f81e9f75a10405/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:41.295777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:41.318650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5abc4-068a-45fe-bb2d-e57c7abd410f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:41.416155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be84dc2-0432-4005-a110-c7cb3ee8712d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:41.424949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.425735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.425900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.426285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.426679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.427026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.427450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.427865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.428386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:41.428767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.430866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8576e-d8b5-450b-af47-9b7cac083fbd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:41.455104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.458767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:41.466101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1038/2086] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:41.466101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27343-b068-4fdd-9344-50686884720a None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.466555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27343-b068-4fdd-9344-50686884720a None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.467252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca27343-b068-4fdd-9344-50686884720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.489359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1049/2087] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:41.504206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:41.546257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1f9e1-a232-4e12-84ec-e073e3b0efd8 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:41.546928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-8ca27343-b068-4fdd-9344-50686884720a None None] MFA Rules not processed for user `e967e25022e44bd295f81e9f75a10405`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:41.549201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8ca27343-b068-4fdd-9344-50686884720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:41.576697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.579551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.580209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.581535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.582481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.590716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:41.716887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1039/2088] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:41.721440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca27343-b068-4fdd-9344-50686884720a None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:41.726332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1050/2089] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:41 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:41.727421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:41.740849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca27343-b068-4fdd-9344-50686884720a None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:41.881630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c99d8b-33b7-42b2-80aa-e9a414a35f0a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:41.884187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.886588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.888683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.888987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.891023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.896823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:41.917385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:41.919908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:41.922483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:41.922901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:41.923793 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:41.930322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.079141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1040/2090] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:41 2022] POST /identity/v3/projects => generated 375 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:42.083824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.133472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1051/2091] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:41 2022] POST /identity/v3/users => generated 287 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:42.137472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.151207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26708b2d-fdbe-4c42-b5f2-f97e5389be39 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.179219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475175b-0802-4c81-bd2d-18c1da3ac65e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.184396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.185072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.185531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.185812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.186581 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.189576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.273471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.274725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.275184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.281501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.281501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.281501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.292642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1052/2092] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:42.293831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.297241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:42.311383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a828f8-9221-493c-8677-a296c5c4a282 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.315917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1041/2093] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:42 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:42.318414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.320613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.321875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.322445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.322934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] PATH_INFO: `/v3/projects/9fe8ea8b6b94449f990f6600a13baded` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.324482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe8ea8b6b94449f990f6600a13baded)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.326728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.344747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53949b-7b4d-45f2-8a2c-3e9eb5aae0e0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.354008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.354891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.355528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.356013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.357108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.359298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.377610 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1042/2094] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:42.378923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.402685 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb8ee3-6b57-49cf-bb17-c0515811bbaa admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.412001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.413214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.413643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.419483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.419483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.419483 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.437576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1043/2095] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:42.438920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.464338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df843d7-3411-46ca-8c50-1c14b729a6ac admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.471114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.473348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.476077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.476842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] PATH_INFO: `/v3/projects/e9ba0d67b78f4c59b3d8e1ea5ae2895d/users/0b6057ad951e418a9d60de92517ae089/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.508315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe8ea8b6b94449f990f6600a13baded', 'request_id': 'req-bc901051-2009-4111-95b8-5031a5373bbe'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:42.545679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ba0d67b78f4c59b3d8e1ea5ae2895d, user_id=0b6057ad951e418a9d60de92517ae089, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.554489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.592053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe8ea8b6b94449f990f6600a13baded', 'request_id': 'req-bc901051-2009-4111-95b8-5031a5373bbe'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:42.601164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe8ea8b6b94449f990f6600a13baded', 'request_id': 'req-bc901051-2009-4111-95b8-5031a5373bbe'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:42.618258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] The token cache is being invalidate because project 9fe8ea8b6b94449f990f6600a13baded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:42.618971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:42.620259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:42.622846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1053/2096] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:42 2022] DELETE /identity/v3/projects/9fe8ea8b6b94449f990f6600a13baded => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:42.624245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.626120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:42.663628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1044/2097] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:42 2022] PUT /identity/v3/projects/e9ba0d67b78f4c59b3d8e1ea5ae2895d/users/0b6057ad951e418a9d60de92517ae089/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:42.668739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:42.672439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:42.813644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc901051-2009-4111-95b8-5031a5373bbe admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.881867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9498c-00c0-485d-8235-0a34810b4b28 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:42.893901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.904173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.904849 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.905363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] PATH_INFO: `/v3/users/d763d6b0edb2403ab74df7ac5fd9e4f2` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.906984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d763d6b0edb2403ab74df7ac5fd9e4f2)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.909748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.966398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb779beb-eab5-47e9-b4da-5c87504be994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:42.967532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb779beb-eab5-47e9-b4da-5c87504be994 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.968022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb779beb-eab5-47e9-b4da-5c87504be994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.968445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb779beb-eab5-47e9-b4da-5c87504be994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:42.969564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb779beb-eab5-47e9-b4da-5c87504be994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:42.972238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb779beb-eab5-47e9-b4da-5c87504be994 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:42.986429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1054/2098] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:42.988160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:42.988634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:42.989085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:43.010890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:43.012500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:43.021546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1055/2099] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:43.024945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:43.040697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d7470-a851-47ca-be93-9245ffeaff9a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:43.051652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:43.055980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:43.056324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:43.059086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] PATH_INFO: `/v3/projects/aec20d6b953c46bdb7cfa57d8a953afd/users/7a98d9f67a694ae5bcb7443e57b1f650/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:43.084417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec20d6b953c46bdb7cfa57d8a953afd, user_id=7a98d9f67a694ae5bcb7443e57b1f650, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:43.087768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:43.190834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd763d6b0edb2403ab74df7ac5fd9e4f2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:43.225002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd763d6b0edb2403ab74df7ac5fd9e4f2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:43.225781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd763d6b0edb2403ab74df7ac5fd9e4f2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:43.243377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd763d6b0edb2403ab74df7ac5fd9e4f2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:43.250289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c52df690-beab-459b-88f5-7038b25fcd24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd763d6b0edb2403ab74df7ac5fd9e4f2'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:43.250417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1056/2100] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:43 2022] PUT /identity/v3/projects/aec20d6b953c46bdb7cfa57d8a953afd/users/7a98d9f67a694ae5bcb7443e57b1f650/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:43.251462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:43.254236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:43.347422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cf358-e993-489c-936b-2d4e4b6689ff admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:43.351892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:43.352584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:43.352876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:43.353157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:43.355403 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:43.376705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1045/2101] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:42 2022] DELETE /identity/v3/users/d763d6b0edb2403ab74df7ac5fd9e4f2 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:43.376705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:43.377234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:43.377326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:43.461073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] MFA Rules not processed for user `7a98d9f67a694ae5bcb7443e57b1f650`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:43.469831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:43.531718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:43.534333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:43.554015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1057/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:43.672695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:43.673059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1046/2103] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:43.675026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:43.692335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e6a5d-7a0c-4205-a10f-6081c16ddefa service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:43.808892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:43.810836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:43.812768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:43.812768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:43.814797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:43.818240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:43.958659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1058/2104] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:43 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:43.962086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:43.983001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce436b8-c5f1-4b7b-9102-f7964557919e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:44.113732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:44.114964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.115404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.115829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.116681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:44.119041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:44.196675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1047/2105] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:43 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:44.199557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:44.222687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914b00-1cf1-4288-9e1e-fd75173e1a76 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:44.234338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:44.235306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.236773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.237430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.238813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:44.243809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:44.267372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1059/2106] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:44.271448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:44.292881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716de1df-4ecb-493b-b424-6767e915418f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:44.304977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:44.305933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.306270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.312823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] PATH_INFO: `/v3/projects/e1e714728f8a4eceb41aa04d23e9b514/users/78173ea313bd49c18f1d57a5a56fb958/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.338236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e714728f8a4eceb41aa04d23e9b514, user_id=78173ea313bd49c18f1d57a5a56fb958, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:44.343289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:44.426307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1048/2107] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:44 2022] PUT /identity/v3/projects/e1e714728f8a4eceb41aa04d23e9b514/users/78173ea313bd49c18f1d57a5a56fb958/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:44.430732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:44.462298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d620b-743b-4887-8a85-cb006d0666c1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:44.629333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:44.630337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.630765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.633677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.633677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:44.634036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:44.694607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1060/2108] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:44.696522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:44.722714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3ae23-b2e4-4e8f-99d3-2ef03d58080b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:44.734864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da86993-af37-445e-a3d4-9aae3c0c79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:44.738196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86993-af37-445e-a3d4-9aae3c0c79ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.738196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86993-af37-445e-a3d4-9aae3c0c79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.738196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da86993-af37-445e-a3d4-9aae3c0c79ba admin admin] PATH_INFO: `/v3/projects/e1e714728f8a4eceb41aa04d23e9b514/users/78173ea313bd49c18f1d57a5a56fb958/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.739851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da86993-af37-445e-a3d4-9aae3c0c79ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e714728f8a4eceb41aa04d23e9b514, user_id=78173ea313bd49c18f1d57a5a56fb958, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:44.757062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da86993-af37-445e-a3d4-9aae3c0c79ba admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:44.779933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1049/2109] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:44 2022] PUT /identity/v3/projects/e1e714728f8a4eceb41aa04d23e9b514/users/78173ea313bd49c18f1d57a5a56fb958/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:44.782114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:44.784464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:44.791521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.791812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.792094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.812511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e1a9-82fb-4244-9791-82678904da63 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:44.835983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] MFA Rules not processed for user `78173ea313bd49c18f1d57a5a56fb958`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:44.837804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:44.933723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:44.934005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:44.934292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:44.934568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] PATH_INFO: `/v3/projects/a5a94c2606044e1281bfd01398d8dc07` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:44.935849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a94c2606044e1281bfd01398d8dc07)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:44.937765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:44.963889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1050/2110] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:44.973117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:44.976500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:45.101831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902f6d-4c65-4226-a9bd-983246013d9d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:45.110202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fff1bd-257e-4978-aef1-f6f81c945d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:45.112030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff1bd-257e-4978-aef1-f6f81c945d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:45.112707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff1bd-257e-4978-aef1-f6f81c945d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:45.113178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff1bd-257e-4978-aef1-f6f81c945d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:45.125055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fff1bd-257e-4978-aef1-f6f81c945d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:45.127115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fff1bd-257e-4978-aef1-f6f81c945d21 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:45.154152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1051/2111] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:45.165120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a94c2606044e1281bfd01398d8dc07', 'request_id': 'req-8abe8125-31ea-4b57-8894-1c392afc5253'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:45.254781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a94c2606044e1281bfd01398d8dc07', 'request_id': 'req-8abe8125-31ea-4b57-8894-1c392afc5253'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:45.261439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a94c2606044e1281bfd01398d8dc07', 'request_id': 'req-8abe8125-31ea-4b57-8894-1c392afc5253'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:45.275346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] The token cache is being invalidate because project a5a94c2606044e1281bfd01398d8dc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:45.276020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:45.277117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:45.285455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da987c-d37a-4fa7-be88-e96d61872bb2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:45.286187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da987c-d37a-4fa7-be88-e96d61872bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:45.287025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da987c-d37a-4fa7-be88-e96d61872bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:45.289470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1061/2112] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:44 2022] DELETE /identity/v3/projects/a5a94c2606044e1281bfd01398d8dc07 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:45.314966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-92da987c-d37a-4fa7-be88-e96d61872bb2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:45.316487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-92da987c-d37a-4fa7-be88-e96d61872bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:45.370600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:45.373170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:45.419501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1052/2113] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:45.450934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe8125-31ea-4b57-8894-1c392afc5253 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:45.453429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:45.454063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:45.454222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:45.466846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:45.467940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:45.468488 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:45.469229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:45.473856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:45.478654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:45.480155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:45.494832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1053/2114] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:45.499024 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:45.510482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5eaad-1d60-43c3-8a61-63af55db934f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:45.515582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:45.516250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:45.516533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:45.516867 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:45.517604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:45.517912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:45.519583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:45.533453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1054/2115] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:45.539072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:45.549442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:45.551019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86c752-d818-44d0-a5be-50c295db496b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:45.551140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:45.556150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:45.556954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:45.557363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:45.557746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:45.558618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:45.560994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1062/2116] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:45.566454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:45.979152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1055/2117] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:45 2022] POST /identity/v3/projects => generated 375 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:45.983971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:45.995036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5043b2-9622-4aad-abb6-10ffd9067816 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:46.108094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:46.108790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:46.109079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:46.109422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:46.110109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:46.112131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:46.280549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1063/2118] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:45 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:46.282086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:46.297496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160764a2-5477-4600-9fc5-b5bee3cfc950 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:46.312321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:46.313452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:46.314555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:46.314834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:46.315584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:46.333143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:46.372448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:46.381605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1056/2119] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:46.412850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac57217-ed5d-4d46-a0ef-13df050aaf69 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:46.427289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290572d8-f67c-4516-81d4-f5bbbd10d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:46.427992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290572d8-f67c-4516-81d4-f5bbbd10d392 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:46.428399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290572d8-f67c-4516-81d4-f5bbbd10d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:46.428745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290572d8-f67c-4516-81d4-f5bbbd10d392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:46.429575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290572d8-f67c-4516-81d4-f5bbbd10d392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:46.435857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290572d8-f67c-4516-81d4-f5bbbd10d392 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:46.463360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:46.463977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1064/2120] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:46.481316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa59cc-8a25-4a6b-a03c-ecae0cbb3d5e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:46.503399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:46.504331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:46.504620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:46.504904 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] PATH_INFO: `/v3/projects/aa86b7e2b16c47df9b3ea00e09ba2739/users/be78b6b530c94e699dfa3ec2682b9caf/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:46.553692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa86b7e2b16c47df9b3ea00e09ba2739, user_id=be78b6b530c94e699dfa3ec2682b9caf, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:46.568853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:46.695790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1057/2121] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:46 2022] PUT /identity/v3/projects/aa86b7e2b16c47df9b3ea00e09ba2739/users/be78b6b530c94e699dfa3ec2682b9caf/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:46.706440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47671b-c79e-4440-83ea-fd38ca96b084 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:46.707754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47671b-c79e-4440-83ea-fd38ca96b084 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:46.708247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47671b-c79e-4440-83ea-fd38ca96b084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:46.806935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9f47671b-c79e-4440-83ea-fd38ca96b084 None None] MFA Rules not processed for user `be78b6b530c94e699dfa3ec2682b9caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:46.811241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9f47671b-c79e-4440-83ea-fd38ca96b084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:46.984926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1065/2122] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:47.013128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:47.111479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee8c8e2-5446-4360-9640-ea7e01bf483f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:47.115808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:47.116576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:47.116974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:47.117353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:47.128559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:47.130284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:47.140842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1058/2123] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:47.457959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e42fe6-724a-40d8-b20d-48202a5447d6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:47.458650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e42fe6-724a-40d8-b20d-48202a5447d6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:47.459201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e42fe6-724a-40d8-b20d-48202a5447d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:47.528022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c1e42fe6-724a-40d8-b20d-48202a5447d6 None None] MFA Rules not processed for user `0b6057ad951e418a9d60de92517ae089`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:47.529256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c1e42fe6-724a-40d8-b20d-48202a5447d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:47.653649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1066/2124] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:47.691016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:47.693152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:47.705234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd7217-ebdb-453a-b85c-d40457c9cbd4 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:47.721439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d367cb-6492-46c2-9f09-44ee79687198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:47.727300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d367cb-6492-46c2-9f09-44ee79687198 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:47.727300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d367cb-6492-46c2-9f09-44ee79687198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:47.727300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d367cb-6492-46c2-9f09-44ee79687198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:47.732506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d367cb-6492-46c2-9f09-44ee79687198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:47.734341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d367cb-6492-46c2-9f09-44ee79687198 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:47.747964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1059/2125] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:47.873124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:47.873529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:47.873913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:47.900037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] MFA Rules not processed for user `052eaf73262c40e38e14b440fd093738`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:47.901559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:47.996755 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1067/2126] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:49.282019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66244a6f-a0c4-425a-85a7-9fe12c89e544 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:49.283014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66244a6f-a0c4-425a-85a7-9fe12c89e544 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:49.283202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66244a6f-a0c4-425a-85a7-9fe12c89e544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:49.323871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-66244a6f-a0c4-425a-85a7-9fe12c89e544 None None] MFA Rules not processed for user `797d50f3ba6244f4a62b3abfa24410d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:49.332995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-66244a6f-a0c4-425a-85a7-9fe12c89e544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:49.404812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1060/2127] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:49.417470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:49.419223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:49.497471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c27dd-acf6-423b-8e6b-5e9d8117cfba None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:49.502530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:49.503255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:49.503611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:49.503986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:49.514040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:49.516347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:49.526509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1068/2128] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:49.833035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:49.833506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:49.834101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:49.857309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] MFA Rules not processed for user `0b6057ad951e418a9d60de92517ae089`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:49.859239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:49.875369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1061/2129] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:51.013440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:51.015485 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:51.094339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54681b-80be-4795-9490-8d62d88963a9 service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:51.100601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:51.101651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:51.102177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:51.102562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] PATH_INFO: `/v3/users/e967e25022e44bd295f81e9f75a10405` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:51.103910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e967e25022e44bd295f81e9f75a10405)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:51.105996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:51.400833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e967e25022e44bd295f81e9f75a10405'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.401741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e967e25022e44bd295f81e9f75a10405'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.402260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e967e25022e44bd295f81e9f75a10405'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.540171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:51.541822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:51.545214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e967e25022e44bd295f81e9f75a10405'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.555451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-9583d441-11d0-4b0b-9128-ed6a9b9ace74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e967e25022e44bd295f81e9f75a10405'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.560405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc848ce9-cf8c-44e7-9f88-1bf96c947eae None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:51.573053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:51.574287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:51.574737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:51.575295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] PATH_INFO: `/v3/users/0893f54529a64a59b00ced9da3ceb1bc` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:51.576733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0893f54529a64a59b00ced9da3ceb1bc)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:51.578942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:51.579092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1069/2130] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:51 2022] DELETE /identity/v3/users/e967e25022e44bd295f81e9f75a10405 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:51.584490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:51.584785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:51.585736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:51.615589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:51.616973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:51.704645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1070/2131] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:51.718742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:51.720728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:51.810825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4a5db-33b1-4989-b19a-bd00720594e9 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:51.811472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0893f54529a64a59b00ced9da3ceb1bc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.833737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e92c09-aef7-4d44-9129-508e8feab106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:51.834446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c09-aef7-4d44-9129-508e8feab106 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:51.834732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c09-aef7-4d44-9129-508e8feab106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:51.835068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e92c09-aef7-4d44-9129-508e8feab106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:51.852517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0893f54529a64a59b00ced9da3ceb1bc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.853413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0893f54529a64a59b00ced9da3ceb1bc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.854267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e92c09-aef7-4d44-9129-508e8feab106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:51.857646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e92c09-aef7-4d44-9129-508e8feab106 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:51.865237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0893f54529a64a59b00ced9da3ceb1bc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.866238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0893f54529a64a59b00ced9da3ceb1bc'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:51.867060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1071/2132] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:11:52.009731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1062/2133] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:51 2022] DELETE /identity/v3/users/0893f54529a64a59b00ced9da3ceb1bc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:52.014694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:52.015711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:52.015989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:52.035058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:52.036587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:52.108256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1072/2134] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:52.119305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:52.120981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:52.227081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d6651-66fc-45c5-a3f7-55d30bfed73e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:52.231277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:52.232794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:52.232794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:52.232794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:52.244506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:52.246001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:52.257620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1063/2135] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:52.398021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:52.400161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:52.424760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272812e-69d5-4370-a20b-958b1ea9ba7b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:52.455446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:52.457583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:52.457883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:52.458215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] PATH_INFO: `/v3/users/be78b6b530c94e699dfa3ec2682b9caf` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:52.463941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be78b6b530c94e699dfa3ec2682b9caf)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:52.466496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:52.828918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:52.830851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:52.845290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0f125-75d5-42ba-971d-0c94e92b5676 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:52.850922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:52.852985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:52.852985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:52.853194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] PATH_INFO: `/v3/projects/947bf499afe44dedbfa8cafb0177d9f6` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:52.854640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=947bf499afe44dedbfa8cafb0177d9f6)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:52.857035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:52.923768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be78b6b530c94e699dfa3ec2682b9caf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:52.924535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be78b6b530c94e699dfa3ec2682b9caf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:52.925190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be78b6b530c94e699dfa3ec2682b9caf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.040901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947bf499afe44dedbfa8cafb0177d9f6', 'request_id': 'req-54482c29-3c3d-41c1-a30e-611ece8ede1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.053866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947bf499afe44dedbfa8cafb0177d9f6', 'request_id': 'req-54482c29-3c3d-41c1-a30e-611ece8ede1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.054108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be78b6b530c94e699dfa3ec2682b9caf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.064718 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be78b6b530c94e699dfa3ec2682b9caf'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.077023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947bf499afe44dedbfa8cafb0177d9f6', 'request_id': 'req-54482c29-3c3d-41c1-a30e-611ece8ede1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.091168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1073/2136] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:52 2022] DELETE /identity/v3/users/be78b6b530c94e699dfa3ec2682b9caf => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:53.095715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:53.097191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.174304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] The token cache is being invalidate because project 947bf499afe44dedbfa8cafb0177d9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:53.174602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.175262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-54482c29-3c3d-41c1-a30e-611ece8ede1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.177076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1064/2137] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:52 2022] DELETE /identity/v3/projects/947bf499afe44dedbfa8cafb0177d9f6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:53.178371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.178657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.179428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.205382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5ba11-e957-4ca9-b560-066cf747b31e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:53.214034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:53.214979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.215419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.216014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] PATH_INFO: `/v3/projects/1ca366dd7f424afa84f7a4bb5255652a` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.217454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca366dd7f424afa84f7a4bb5255652a)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:53.220181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:53.229735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:53.231966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.246286 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1065/2138] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:53.247351 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:53.249245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.265393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a7d4f-5038-4c93-b8da-5f1dbe712acd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:53.276140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:53.276140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.276140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.276140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] PATH_INFO: `/v3/users/7a98d9f67a694ae5bcb7443e57b1f650` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.276560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a98d9f67a694ae5bcb7443e57b1f650)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:53.276560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:53.379907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca366dd7f424afa84f7a4bb5255652a', 'request_id': 'req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.488013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca366dd7f424afa84f7a4bb5255652a', 'request_id': 'req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.494269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca366dd7f424afa84f7a4bb5255652a', 'request_id': 'req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.506948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] The token cache is being invalidate because project 1ca366dd7f424afa84f7a4bb5255652a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:53.507251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.507914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.510152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1074/2139] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:53 2022] DELETE /identity/v3/projects/1ca366dd7f424afa84f7a4bb5255652a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:53.513596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:53.515637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.539247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a98d9f67a694ae5bcb7443e57b1f650'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.553320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a98d9f67a694ae5bcb7443e57b1f650'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.554347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a98d9f67a694ae5bcb7443e57b1f650'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.562789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a98d9f67a694ae5bcb7443e57b1f650'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.563773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ae4f1d1d-302d-4c8a-b717-a4673694fb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a98d9f67a694ae5bcb7443e57b1f650'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:53.607063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f268cf-dc99-49ca-958b-ad8ad8d9ebde admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:53.611634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:53.612512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.612954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.613374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.621339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.648662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1066/2140] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:53 2022] DELETE /identity/v3/users/7a98d9f67a694ae5bcb7443e57b1f650 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:53.651037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.652215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.652505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.676888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:53.679759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.694420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:53.695899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:53.708816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1075/2141] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:53.709867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:53.712077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.726261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35156289-b298-4d16-8573-94fae3bc8c66 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:53.774304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1067/2142] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:11:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:53.788366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:53.789947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:53.815858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:53.818011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.818657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.819221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] PATH_INFO: `/v3/users/468fe6aa505d4a92b881dc303d0371db` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.820891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468fe6aa505d4a92b881dc303d0371db)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:53.824405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:53.872744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999804c-28f9-4377-a5c8-532931a0e796 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:53.878238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:53.878961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:53.879308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:53.879888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:53.889470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:53.891150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:53.900067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1068/2143] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 26 14:11:54.222171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:54.226070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:54.241855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468fe6aa505d4a92b881dc303d0371db'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.242691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468fe6aa505d4a92b881dc303d0371db'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.247522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468fe6aa505d4a92b881dc303d0371db'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.270635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c3028-09ba-4288-90b8-6303319fd3d6 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:54.290788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:54.296482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:54.297197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:54.299004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] PATH_INFO: `/v3/projects/aec20d6b953c46bdb7cfa57d8a953afd` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:54.302145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec20d6b953c46bdb7cfa57d8a953afd)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:54.307694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:54.379897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468fe6aa505d4a92b881dc303d0371db'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.388955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468fe6aa505d4a92b881dc303d0371db'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.464253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1076/2144] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:53 2022] DELETE /identity/v3/users/468fe6aa505d4a92b881dc303d0371db => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:54.545692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec20d6b953c46bdb7cfa57d8a953afd', 'request_id': 'req-16021b13-306b-4865-bad0-0c23c6e89a6a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.561253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec20d6b953c46bdb7cfa57d8a953afd', 'request_id': 'req-16021b13-306b-4865-bad0-0c23c6e89a6a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.569217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec20d6b953c46bdb7cfa57d8a953afd', 'request_id': 'req-16021b13-306b-4865-bad0-0c23c6e89a6a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.667416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] The token cache is being invalidate because project aec20d6b953c46bdb7cfa57d8a953afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:54.667416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.667987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-16021b13-306b-4865-bad0-0c23c6e89a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:54.674356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1069/2145] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:54 2022] DELETE /identity/v3/projects/aec20d6b953c46bdb7cfa57d8a953afd => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:11:54.676327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:54.680049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:54.835489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:54.836034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:54.836506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:54.888101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] MFA Rules not processed for user `797d50f3ba6244f4a62b3abfa24410d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:54.891188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:54.921771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e437f-a578-4076-a8f1-2f7b9e2ba7f0 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:55.104191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1070/2146] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:55.117951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:55.118925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.119149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.121242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] PATH_INFO: `/v3/users/78173ea313bd49c18f1d57a5a56fb958` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.122181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78173ea313bd49c18f1d57a5a56fb958)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:55.124785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:55.148360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:55.161185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:55.197023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c164a-a315-4c6d-a3cf-311a36d2949d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:55.205322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:55.206666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.207012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.207341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] PATH_INFO: `/v3/projects/aa86b7e2b16c47df9b3ea00e09ba2739` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.208948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa86b7e2b16c47df9b3ea00e09ba2739)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:55.212130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:55.395692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78173ea313bd49c18f1d57a5a56fb958'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.396647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78173ea313bd49c18f1d57a5a56fb958'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.398605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78173ea313bd49c18f1d57a5a56fb958'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.431823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa86b7e2b16c47df9b3ea00e09ba2739', 'request_id': 'req-dd6cfcf5-4174-49be-9945-c6d0a459917e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.449095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa86b7e2b16c47df9b3ea00e09ba2739', 'request_id': 'req-dd6cfcf5-4174-49be-9945-c6d0a459917e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.461672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa86b7e2b16c47df9b3ea00e09ba2739', 'request_id': 'req-dd6cfcf5-4174-49be-9945-c6d0a459917e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.505348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78173ea313bd49c18f1d57a5a56fb958'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.518316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78173ea313bd49c18f1d57a5a56fb958'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.547115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1077/2147] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:11:54 2022] DELETE /identity/v3/users/78173ea313bd49c18f1d57a5a56fb958 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:55.549095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:55.551509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:55.648431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] The token cache is being invalidate because project aa86b7e2b16c47df9b3ea00e09ba2739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:55.648859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.649676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dd6cfcf5-4174-49be-9945-c6d0a459917e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:55.656252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1071/2148] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:55 2022] DELETE /identity/v3/projects/aa86b7e2b16c47df9b3ea00e09ba2739 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:55.666414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca437c5-acba-491d-a331-f77681754673 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.667008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca437c5-acba-491d-a331-f77681754673 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.668140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca437c5-acba-491d-a331-f77681754673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.695968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4ca437c5-acba-491d-a331-f77681754673 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:55.707596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4ca437c5-acba-491d-a331-f77681754673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:55.721155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e4004-8dd3-4a01-9cdc-eacad05f3079 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:55.725675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:55.726587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.726870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.727149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] PATH_INFO: `/v3/projects/4ccb1f4112214903b4057d9df13e1209` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.728351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccb1f4112214903b4057d9df13e1209)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:55.730322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:55.739276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1072/2149] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:55.751332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.752018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.752533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.804283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:55.806091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:55.818846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1073/2150] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:55.823501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:55.849269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1e581-ac78-4564-8df0-4ebb3deddca8 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:55.870984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:55.871909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.872326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.872775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.874558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:55.875066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:55.878234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:55.904901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1074/2151] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:55.906641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:55.932312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768087f-6995-4060-94c7-59eec26653a3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:55.939645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:55.940766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:55.941201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:55.941911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:55.943308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:55.946082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.034512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccb1f4112214903b4057d9df13e1209', 'request_id': 'req-64602598-e9fd-409e-81fb-6f4df3af4371'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:56.119444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1075/2152] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:55 2022] POST /identity/v3/projects => generated 389 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:56.125057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.163307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccb1f4112214903b4057d9df13e1209', 'request_id': 'req-64602598-e9fd-409e-81fb-6f4df3af4371'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:56.183132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccb1f4112214903b4057d9df13e1209', 'request_id': 'req-64602598-e9fd-409e-81fb-6f4df3af4371'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:56.247556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] The token cache is being invalidate because project 4ccb1f4112214903b4057d9df13e1209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:56.248191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:56.252965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-64602598-e9fd-409e-81fb-6f4df3af4371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:56.254991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1078/2153] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:55 2022] DELETE /identity/v3/projects/4ccb1f4112214903b4057d9df13e1209 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:56.260478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05efa-cd59-4a85-82d2-4ce88ed463dd None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.262248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05efa-cd59-4a85-82d2-4ce88ed463dd None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.262681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd05efa-cd59-4a85-82d2-4ce88ed463dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.294682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27eb72d-853f-4377-ba61-db776df26e09 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.310783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.310783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.310783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.310783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.311307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:56.312113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.334191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-bcd05efa-cd59-4a85-82d2-4ce88ed463dd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:56.335776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bcd05efa-cd59-4a85-82d2-4ce88ed463dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:56.356321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1079/2154] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:56.358705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.359574 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.360870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.396961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:56.406486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:56.419076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1080/2155] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:56.425010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.446372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301f876-12fc-4b90-a022-8ba8b8ffd846 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.460869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1076/2156] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:56 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:56.464925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.468046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:56.506553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.507208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.507499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.507779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.508533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:56.508838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:56.510632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.536324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05adfb-4871-4e8d-8076-a66f6474b4f3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.559846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1081/2157] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:56.565856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.576173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.580639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.580639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.580639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.580639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:56.580639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.582277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3c39-db18-4679-b899-71cfa11aebaf admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.590234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.591601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.592227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.592759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.593626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:56.597222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.629159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1077/2158] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:56.631672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.672914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5639fc7-1dcf-46bb-b364-c0429a09b816 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.696250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.696795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.697081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.697369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.698446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:56.699870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.701692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1082/2159] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:56 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:56.707153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.732878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1078/2160] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:56.734166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.768814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631ff70-5964-491d-8e0a-1852f5b1d1b1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.840532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952de5f-3caf-4338-80ef-87944f1a89ae admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:56.842782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.843586 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.843977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.844369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.845562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:56.848128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:56.975132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1083/2161] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:56 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:11:56.980679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:56.986408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448e6e6-488c-4966-8234-8dde1a73f8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:56.987726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448e6e6-488c-4966-8234-8dde1a73f8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:56.989890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448e6e6-488c-4966-8234-8dde1a73f8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:56.989890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448e6e6-488c-4966-8234-8dde1a73f8a5 admin admin] PATH_INFO: `/v3/projects/5599558948954705acebea366145dba6/users/047fa1e47515423e90a8ebef29370640/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:56.999165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa355e-d39c-4cec-81a6-5b64e3618480 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:57.006107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:57.007665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.012745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.012745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.012745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:57.012745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:57.027786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1084/2162] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:57.032775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:57.033028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448e6e6-488c-4966-8234-8dde1a73f8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5599558948954705acebea366145dba6, user_id=047fa1e47515423e90a8ebef29370640, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:57.037677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448e6e6-488c-4966-8234-8dde1a73f8a5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:57.079780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f1e3-e95d-45e0-98bb-99c8cf83a68f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:57.085122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:57.086238 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.086530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.086814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.088829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:57.093044 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:57.113230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1085/2163] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:57.116648 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:57.127121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc36554-c7a7-4cb0-912b-013d17f4c204 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:57.134090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953336d-b07b-4ad5-ac81-92ba03f23c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:57.135444 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953336d-b07b-4ad5-ac81-92ba03f23c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.135856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953336d-b07b-4ad5-ac81-92ba03f23c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.136175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953336d-b07b-4ad5-ac81-92ba03f23c8a admin admin] PATH_INFO: `/v3/projects/cb66cbf12f5c4c2aaa6e558991f63d2e/users/65fa5fe2b3834128a92e559429cfa03b/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.164085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953336d-b07b-4ad5-ac81-92ba03f23c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb66cbf12f5c4c2aaa6e558991f63d2e, user_id=65fa5fe2b3834128a92e559429cfa03b, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:57.169473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953336d-b07b-4ad5-ac81-92ba03f23c8a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:57.201707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1079/2164] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:56 2022] PUT /identity/v3/projects/5599558948954705acebea366145dba6/users/047fa1e47515423e90a8ebef29370640/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:57.212846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.219105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.226223 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.256736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1086/2165] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:57 2022] PUT /identity/v3/projects/cb66cbf12f5c4c2aaa6e558991f63d2e/users/65fa5fe2b3834128a92e559429cfa03b/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:57.267832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.268246 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.268612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.270270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] MFA Rules not processed for user `047fa1e47515423e90a8ebef29370640`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:57.271559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:57.343210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] MFA Rules not processed for user `65fa5fe2b3834128a92e559429cfa03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:57.345612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:57.452350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1080/2166] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:57.468885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:57.474319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:57.639191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1087/2167] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:57.642452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:57.644297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:57.672031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6dcb2-08b9-4c66-9c12-0458a8a2b51b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:57.678871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:57.680527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.681031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.681558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] PATH_INFO: `/v3/projects/e1e714728f8a4eceb41aa04d23e9b514` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.683757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e714728f8a4eceb41aa04d23e9b514)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:57.686627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:57.813503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec83be-b30f-42a8-bc2c-a4cae104bee1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:57.819375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:57.820073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:57.820568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:57.820818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:57.851744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:57.853604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:57.865933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1088/2168] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:11:57.867057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:57.873915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e714728f8a4eceb41aa04d23e9b514', 'request_id': 'req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:57.883068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e714728f8a4eceb41aa04d23e9b514', 'request_id': 'req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:57.892707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a85f4-5b1f-4f72-844e-5382d28e806b service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:57.893906 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e714728f8a4eceb41aa04d23e9b514', 'request_id': 'req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:58.011222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] The token cache is being invalidate because project e1e714728f8a4eceb41aa04d23e9b514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:11:58.011918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:58.014270 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-fbfa8fe5-f544-4a5b-bb92-8aa46f873003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:11:58.018111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1081/2169] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:11:57 2022] DELETE /identity/v3/projects/e1e714728f8a4eceb41aa04d23e9b514 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:58.040280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e02d-16a1-4575-8aad-14e735e25104 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.040564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e02d-16a1-4575-8aad-14e735e25104 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.048158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e02d-16a1-4575-8aad-14e735e25104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.111297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f759e02d-16a1-4575-8aad-14e735e25104 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:58.113235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f759e02d-16a1-4575-8aad-14e735e25104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:58.340684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1082/2170] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:58.358067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.358354 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.360892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.415580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:58.417008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:58.432376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1083/2171] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:11:58.436390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:58.453542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:58.453542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.453542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.453542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.454067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:58.461391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:58.472369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76168d-87fb-4bc0-84ac-dc01b594afda None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:58.505502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:58.506984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.507285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.507563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.508304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:11:58.508611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:58.514301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:58.543551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1084/2172] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:11:58.551051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:58.582413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6709879-947f-4ef5-8052-de0fe8ffafcc admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:58.585635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1089/2173] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:57 2022] POST /identity/v3/projects => generated 387 bytes in 719 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:58.589535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:58.593754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:58.757011 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:58.762369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.762369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.762369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.763543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:58.772089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5386a-b8b3-4981-b850-2f558db25a82 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:58.792786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:58.793486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.793776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.794094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.794806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:58.802903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:58.803537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:58.905437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1090/2174] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:58 2022] POST /identity/v3/users => generated 300 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:58.906719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:58.921385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25957c-00ef-4632-80ee-b6841ba82d8d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:58.947081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:58.948955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:58.952537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:58.953038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:58.962969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1085/2175] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:11:58 2022] POST /identity/v3/projects => generated 373 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:58.965125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:58.971486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:58.983267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.017838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1091/2176] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:59.022549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.062623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c2c6c-2b97-41b8-803b-6f1db7562a69 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.140635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3eda3-6cf6-47db-8694-a21405225bbd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.158861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.159646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.159931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.160267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.161044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.168290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.218570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.219429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.220801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.221130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] PATH_INFO: `/v3/projects/a6c82fc5519b491b86701803841ae677/users/5cc2cfd0405c4e46a40c46a6488b15f0/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.263406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c82fc5519b491b86701803841ae677, user_id=5cc2cfd0405c4e46a40c46a6488b15f0, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.266181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.365160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1086/2177] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:11:58 2022] POST /identity/v3/users => generated 287 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:11:59.369469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.384398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a73a-fb16-4bb9-8070-d257f99c5f93 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.389345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.390358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.390732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.391009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.391882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.393248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1092/2178] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:59 2022] PUT /identity/v3/projects/a6c82fc5519b491b86701803841ae677/users/5cc2cfd0405c4e46a40c46a6488b15f0/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:59.393784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.398215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.415491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1087/2179] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:59.416668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.436126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f694d-8a00-4e47-a317-390d0858fb6a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.509617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8836a-475e-4dbd-9aec-adb86441317e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.518294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.519030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.524050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.524384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.525163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.529843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.552736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1093/2180] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:11:59.553751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.565753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.566841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.567403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.567871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.570521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.572726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.577034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba82299-de85-4740-969f-c875f10f1dec admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.585459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeca55d-e965-4937-b845-6f3abd124640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.586415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca55d-e965-4937-b845-6f3abd124640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.586701 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca55d-e965-4937-b845-6f3abd124640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.586974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca55d-e965-4937-b845-6f3abd124640 admin admin] PATH_INFO: `/v3/projects/a6c82fc5519b491b86701803841ae677/users/5cc2cfd0405c4e46a40c46a6488b15f0/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.590847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1088/2181] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:11:59.596189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.598714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeca55d-e965-4937-b845-6f3abd124640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6c82fc5519b491b86701803841ae677, user_id=5cc2cfd0405c4e46a40c46a6488b15f0, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.602430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeca55d-e965-4937-b845-6f3abd124640 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.613568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460a70c-3eb3-4ba4-8b5b-4c0963d076d7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:11:59.631422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398d045-f479-49fe-be3b-e7b494b9f3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:11:59.634203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d045-f479-49fe-be3b-e7b494b9f3d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.634502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d045-f479-49fe-be3b-e7b494b9f3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.634791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d045-f479-49fe-be3b-e7b494b9f3d9 admin admin] PATH_INFO: `/v3/projects/6d338516acd04d069fb897ccf1a10e89/users/ff528330afb4492784770ca349bd1c95/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.642560 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1094/2182] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:59 2022] PUT /identity/v3/projects/a6c82fc5519b491b86701803841ae677/users/5cc2cfd0405c4e46a40c46a6488b15f0/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:59.656792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.657202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.657381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.707663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d045-f479-49fe-be3b-e7b494b9f3d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d338516acd04d069fb897ccf1a10e89, user_id=ff528330afb4492784770ca349bd1c95, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:11:59.727074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] MFA Rules not processed for user `5cc2cfd0405c4e46a40c46a6488b15f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:59.728346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:59.736829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398d045-f479-49fe-be3b-e7b494b9f3d9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:11:59.838776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1089/2183] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:11:59 2022] PUT /identity/v3/projects/6d338516acd04d069fb897ccf1a10e89/users/ff528330afb4492784770ca349bd1c95/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:11:59.846051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:11:59.846648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:11:59.847069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:11:59.905320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1095/2184] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:11:59.909633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:11:59.910901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:11:59.944173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:11:59.945722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:00.083361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1090/2185] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:00.084036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849332f2-dc3e-4919-bc7a-7dea635be93e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:00.091145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:00.093697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:00.163054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46872f8-f975-453a-b1ba-53d9d43d01e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:00.165018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46872f8-f975-453a-b1ba-53d9d43d01e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:00.165413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46872f8-f975-453a-b1ba-53d9d43d01e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:00.165794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46872f8-f975-453a-b1ba-53d9d43d01e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:00.185233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828a5bd-1746-4bbe-b819-5c22391efcc2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:00.214509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:00.214509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:00.214509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:00.214509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:00.215340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:00.215340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:00.215340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1091/2186] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:12:00.253309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46872f8-f975-453a-b1ba-53d9d43d01e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:00.254989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46872f8-f975-453a-b1ba-53d9d43d01e6 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:00.267016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1096/2187] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:11:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:00.544227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:00.564546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765af5-3c30-4838-b3a1-000719709ea5 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:00.572513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:00.573480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:00.573751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:00.574053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] PATH_INFO: `/v3/users/65fa5fe2b3834128a92e559429cfa03b` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:00.575521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fa5fe2b3834128a92e559429cfa03b)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:00.577773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:01.088175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fa5fe2b3834128a92e559429cfa03b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:01.117720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fa5fe2b3834128a92e559429cfa03b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:01.117720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fa5fe2b3834128a92e559429cfa03b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:01.117720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fa5fe2b3834128a92e559429cfa03b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:01.118338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fa5fe2b3834128a92e559429cfa03b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:01.220597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1092/2188] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:00 2022] DELETE /identity/v3/users/65fa5fe2b3834128a92e559429cfa03b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:01.239608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f0953-e3e4-490c-906d-c289d180644a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:01.239608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f0953-e3e4-490c-906d-c289d180644a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:01.239608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f0953-e3e4-490c-906d-c289d180644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:01.284291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-707f0953-e3e4-490c-906d-c289d180644a None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:01.284291 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-707f0953-e3e4-490c-906d-c289d180644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:01.348388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1097/2189] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:01.360672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:01.363320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:01.443331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5062b5-7e4b-487d-9177-e7e75840c84e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:01.462976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:01.463935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:01.465531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:01.466410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:01.492918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:01.498458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:01.530196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1093/2190] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:02.192878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f0953-e3e4-490c-906d-c289d180644a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:02.196924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-707f0953-e3e4-490c-906d-c289d180644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:02.258312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f0953-e3e4-490c-906d-c289d180644a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:02.300484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:02.301813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:02.302300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:02.302871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] PATH_INFO: `/v3/projects/cb66cbf12f5c4c2aaa6e558991f63d2e` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:02.304338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb66cbf12f5c4c2aaa6e558991f63d2e)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:02.306638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:02.446273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb66cbf12f5c4c2aaa6e558991f63d2e', 'request_id': 'req-ba43ec1e-ea2a-401f-9252-b76caf636e05'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:02.535195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb66cbf12f5c4c2aaa6e558991f63d2e', 'request_id': 'req-ba43ec1e-ea2a-401f-9252-b76caf636e05'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:02.542569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb66cbf12f5c4c2aaa6e558991f63d2e', 'request_id': 'req-ba43ec1e-ea2a-401f-9252-b76caf636e05'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:02.555988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] The token cache is being invalidate because project cb66cbf12f5c4c2aaa6e558991f63d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:02.556322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:02.556932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-ba43ec1e-ea2a-401f-9252-b76caf636e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:02.558683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1098/2191] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:02 2022] DELETE /identity/v3/projects/cb66cbf12f5c4c2aaa6e558991f63d2e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:02.562778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:02.604790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0ac7e-7b43-4335-8c2c-8cfd754455ec service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:02.696929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:02.698124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:02.698541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:02.698908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] PATH_INFO: `/v3/users/5cc2cfd0405c4e46a40c46a6488b15f0` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:02.700292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc2cfd0405c4e46a40c46a6488b15f0)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:02.702614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:03.290106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:03.291250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:03.292228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:03.339906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] MFA Rules not processed for user `ff528330afb4492784770ca349bd1c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:03.341141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:03.367379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc2cfd0405c4e46a40c46a6488b15f0'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:03.412216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc2cfd0405c4e46a40c46a6488b15f0'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:03.413222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc2cfd0405c4e46a40c46a6488b15f0'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:03.425697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc2cfd0405c4e46a40c46a6488b15f0'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:03.426481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc2cfd0405c4e46a40c46a6488b15f0'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:03.469520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1099/2192] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:03.474563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:03.476165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:03.492740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4de1a-de22-4b12-aab2-3f26f783dd61 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:03.498355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:03.500376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:03.501265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:03.501542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:03.502279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:03.504219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:03.571461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1094/2193] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:02 2022] DELETE /identity/v3/users/5cc2cfd0405c4e46a40c46a6488b15f0 => generated 0 bytes in 1006 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:03.604351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1100/2194] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:12:03 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:12:03.608313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:03.725232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e170-b05c-45be-9b4b-ac3523332f70 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:03.802851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:03.804044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:03.804332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:03.804613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:03.805315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:03.807557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:03.968738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1095/2195] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:12:03 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:12:03.974287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.003899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616b7d-6eb7-482c-92ea-3e00e69fc18d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.011358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.011817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.012102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.012378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.013123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.014784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:04.033929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1101/2196] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:04.040710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.051596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da4545-c26b-4678-aadf-f17890b4baf8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.059183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.060269 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.060550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.062189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] PATH_INFO: `/v3/projects/948226c2d05645348f0250369ffdef06/users/37c43796356346028ef9138464e249ff/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.088418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.093213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:04.110848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948226c2d05645348f0250369ffdef06, user_id=37c43796356346028ef9138464e249ff, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.117645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fed179-ebba-4ff7-a874-56886afd5c8c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.119403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:04.122765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.123997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.124349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.124748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] PATH_INFO: `/v3/projects/a6c82fc5519b491b86701803841ae677` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.130360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6c82fc5519b491b86701803841ae677)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.134402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:04.209229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1096/2197] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:04 2022] PUT /identity/v3/projects/948226c2d05645348f0250369ffdef06/users/37c43796356346028ef9138464e249ff/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:04.214885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.311805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0379e3e2-97e5-49f7-b036-b301ee3f2423 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.330982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6c82fc5519b491b86701803841ae677', 'request_id': 'req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:04.388407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.392611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.392611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.392611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.392611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.399356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:04.413669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6c82fc5519b491b86701803841ae677', 'request_id': 'req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:04.419703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6c82fc5519b491b86701803841ae677', 'request_id': 'req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:04.424791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1097/2198] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:12:04.426378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.437336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb450700-f32c-4f11-8bf6-68443ec478a3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.443886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700c92b-62e5-46c6-8756-fac627596b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.445159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c92b-62e5-46c6-8756-fac627596b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.445570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c92b-62e5-46c6-8756-fac627596b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.445950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c92b-62e5-46c6-8756-fac627596b8a admin admin] PATH_INFO: `/v3/projects/948226c2d05645348f0250369ffdef06/users/37c43796356346028ef9138464e249ff/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.448173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c92b-62e5-46c6-8756-fac627596b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=948226c2d05645348f0250369ffdef06, user_id=37c43796356346028ef9138464e249ff, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.451200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c92b-62e5-46c6-8756-fac627596b8a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:04.451427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] The token cache is being invalidate because project a6c82fc5519b491b86701803841ae677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:04.451889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:04.452809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc4a83ec-7085-4e79-8d46-d18ff9420bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:04.454663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1102/2199] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:04 2022] DELETE /identity/v3/projects/a6c82fc5519b491b86701803841ae677 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:12:04.460561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566737db-be66-452c-89f1-86e2afe0937e None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.461047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566737db-be66-452c-89f1-86e2afe0937e None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.461489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566737db-be66-452c-89f1-86e2afe0937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.473209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1098/2200] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:04 2022] PUT /identity/v3/projects/948226c2d05645348f0250369ffdef06/users/37c43796356346028ef9138464e249ff/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:12:04.538857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-566737db-be66-452c-89f1-86e2afe0937e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:04.538857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-566737db-be66-452c-89f1-86e2afe0937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:04.623496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1103/2201] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:12:04.637998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.638570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.638570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.671974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:04.673947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:04.683542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1099/2202] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:04.687590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566737db-be66-452c-89f1-86e2afe0937e None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.732855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566737db-be66-452c-89f1-86e2afe0937e None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.748303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.749834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.750153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.750465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.751808 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:12:04.752180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.759728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:04.799101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1104/2203] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:12:04.804018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:04.819248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170cffd-fb10-424a-a484-7177b42733d2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:04.828338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:04.829562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:04.830146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:04.830725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:04.838008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:04.838008 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:05.285155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1100/2204] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:12:04 2022] POST /identity/v3/projects => generated 365 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:12:05.286865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:05.298255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6838-d5f5-435a-b3a7-ead7ecb4eb30 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:05.378533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:05.383349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:05.383349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:05.383349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:05.383349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:05.383349 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:05.606482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1105/2205] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:12:05 2022] POST /identity/v3/users => generated 283 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:12:05.612596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:05.623568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ab66d-ed0a-47ae-9bd4-166008f4f6f0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:05.629014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:05.629615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:05.629819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:05.630159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:05.630882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:05.632502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:05.646310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1101/2206] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:05.652342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:05.665468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9e46-ca80-45b4-b073-5a0ef2186ee0 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:05.670887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949ecf3-768b-4a4e-9d8f-d3127517e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:05.671866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949ecf3-768b-4a4e-9d8f-d3127517e903 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:05.672260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949ecf3-768b-4a4e-9d8f-d3127517e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:05.672678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949ecf3-768b-4a4e-9d8f-d3127517e903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:05.673478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949ecf3-768b-4a4e-9d8f-d3127517e903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:05.675187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949ecf3-768b-4a4e-9d8f-d3127517e903 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:05.688408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1106/2207] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:05.693045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:05.709773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85fc71-314a-4e9b-98cb-923c0270edf4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:05.715322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:05.717546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:05.718720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:05.719690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] PATH_INFO: `/v3/projects/e15d306ded554d27a558ae32f9d432e9/users/3e2dc142d2e945dbaaf917e7770ef150/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:05.744689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15d306ded554d27a558ae32f9d432e9, user_id=3e2dc142d2e945dbaaf917e7770ef150, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:05.748786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:05.885072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1102/2208] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:05 2022] PUT /identity/v3/projects/e15d306ded554d27a558ae32f9d432e9/users/3e2dc142d2e945dbaaf917e7770ef150/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:05.898121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07927-df29-4460-bb54-a162d9010ffb None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:05.898559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07927-df29-4460-bb54-a162d9010ffb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:05.899050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c07927-df29-4460-bb54-a162d9010ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:05.933557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-66c07927-df29-4460-bb54-a162d9010ffb None None] MFA Rules not processed for user `3e2dc142d2e945dbaaf917e7770ef150`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:05.935230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-66c07927-df29-4460-bb54-a162d9010ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:06.042817 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1107/2209] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:06.065096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:06.068534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:06.184378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d657a5-a909-4df1-871a-e91abafa049f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:06.188922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:06.189823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:06.190302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:06.190586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:06.200109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:06.201573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:06.216564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1103/2210] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:12:06.842735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:06.843906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:06.844927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:06.877797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] MFA Rules not processed for user `37c43796356346028ef9138464e249ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:06.878992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:07.025152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1108/2211] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:07.038603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:07.048583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c890d-f63c-4a2f-be98-ba567673551b service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:07.053645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:07.054017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:07.054533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:07.055022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:07.058001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:07.133714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:07.134593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:07.144533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1104/2212] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:09.990206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:10.002540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bf906-4333-4865-96d2-cae99e30c551 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:10.006786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921273e-ef24-4b86-8fa9-5101754cb22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:10.007433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921273e-ef24-4b86-8fa9-5101754cb22e service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:10.007876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921273e-ef24-4b86-8fa9-5101754cb22e service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:10.008157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921273e-ef24-4b86-8fa9-5101754cb22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:10.022049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921273e-ef24-4b86-8fa9-5101754cb22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:10.024175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921273e-ef24-4b86-8fa9-5101754cb22e service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:10.037049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1109/2213] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:20.726592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:20.728067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:20.811711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f186327-7387-4142-b466-8e52e26e7464 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:20.816728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:20.817596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:20.817880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:20.818245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] PATH_INFO: `/v3/users/047fa1e47515423e90a8ebef29370640` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:20.819463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=047fa1e47515423e90a8ebef29370640)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:20.821414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:21.073826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047fa1e47515423e90a8ebef29370640'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:21.086010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047fa1e47515423e90a8ebef29370640'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:21.086803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047fa1e47515423e90a8ebef29370640'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:21.096918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047fa1e47515423e90a8ebef29370640'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:21.096918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-55a93f89-8d1b-430d-b2b2-28520925de5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047fa1e47515423e90a8ebef29370640'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:21.208231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1105/2214] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:20 2022] DELETE /identity/v3/users/047fa1e47515423e90a8ebef29370640 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:21.212816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:21.213271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:21.213474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:21.230698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:21.231824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:21.257682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:21.258222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:21.258574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:21.276262 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] MFA Rules not processed for user `706ce393383a460b9b5857f74224a1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:21.277493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:21.295660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1110/2215] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:21.311635 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:21.313019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:21.343947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1106/2216] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:12:21.396080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421d0c0-aa31-4469-ba3a-14b35b97f511 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:21.400080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e6d7f-ae73-4584-be0d-1c11157716d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:21.400764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e6d7f-ae73-4584-be0d-1c11157716d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:21.401201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e6d7f-ae73-4584-be0d-1c11157716d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:21.401511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e6d7f-ae73-4584-be0d-1c11157716d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:21.411435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e6d7f-ae73-4584-be0d-1c11157716d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:21.413199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e6d7f-ae73-4584-be0d-1c11157716d9 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:21.423174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1111/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:12:21.992689 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:21.994168 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:22.009592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2817163-d8bc-43f9-9600-c80b4d7a9286 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:22.019540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:22.020404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:22.020814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:22.020951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] PATH_INFO: `/v3/projects/5599558948954705acebea366145dba6` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:22.022263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5599558948954705acebea366145dba6)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:22.024376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:22.174848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5599558948954705acebea366145dba6', 'request_id': 'req-a2225d58-e32b-4246-a507-6bf9d559becd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:22.181101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5599558948954705acebea366145dba6', 'request_id': 'req-a2225d58-e32b-4246-a507-6bf9d559becd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:22.188368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5599558948954705acebea366145dba6', 'request_id': 'req-a2225d58-e32b-4246-a507-6bf9d559becd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:22.270325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] The token cache is being invalidate because project 5599558948954705acebea366145dba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:22.270641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:22.271977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a2225d58-e32b-4246-a507-6bf9d559becd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:22.273546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1107/2218] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:21 2022] DELETE /identity/v3/projects/5599558948954705acebea366145dba6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:27.845241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe82ed-a164-41e6-a0ee-92fc890af3ca None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:27.846617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe82ed-a164-41e6-a0ee-92fc890af3ca None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:27.846617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe82ed-a164-41e6-a0ee-92fc890af3ca None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:27.848021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1112/2219] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:12:27.854088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d688-c829-4c27-b8d2-90ac829ba7bc None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:27.855210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d688-c829-4c27-b8d2-90ac829ba7bc None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:27.855494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1d688-c829-4c27-b8d2-90ac829ba7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:27.901073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-efb1d688-c829-4c27-b8d2-90ac829ba7bc None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:27.902554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-efb1d688-c829-4c27-b8d2-90ac829ba7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:27.980332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1108/2220] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:27.993565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe82ed-a164-41e6-a0ee-92fc890af3ca None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:27.995288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f0fe82ed-a164-41e6-a0ee-92fc890af3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:28.014833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe82ed-a164-41e6-a0ee-92fc890af3ca None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:28.020628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:28.021362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:28.021719 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:28.022101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:28.032886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:28.034884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:28.049205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1113/2221] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:29.505113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:29.505113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:29.505113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:29.519793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] MFA Rules not processed for user `0b6057ad951e418a9d60de92517ae089`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:29.521073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:29.582095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1109/2222] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:33.683877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:33.685351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:33.756204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c1519-3004-472e-9ca4-3d77556c1aac service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:33.765155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:33.766347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:33.768566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:33.768566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:33.768805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:33.840329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:33.842658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:33.856640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1114/2223] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:34.228247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:34.231338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:34.321180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065651d3-9765-421f-9ee3-16967f80ebfa None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:34.328004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:34.329489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:34.329953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:34.330274 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] PATH_INFO: `/v3/users/ff528330afb4492784770ca349bd1c95` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:34.331548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff528330afb4492784770ca349bd1c95)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:34.333688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:34.548584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff528330afb4492784770ca349bd1c95'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:34.564915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff528330afb4492784770ca349bd1c95'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:34.565790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff528330afb4492784770ca349bd1c95'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:34.574647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff528330afb4492784770ca349bd1c95'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:34.575536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff528330afb4492784770ca349bd1c95'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:34.711309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1110/2224] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:34 2022] DELETE /identity/v3/users/ff528330afb4492784770ca349bd1c95 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:35.223681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:35.239600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8f95c-e746-450e-8a5b-f0fb08450ba7 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:35.313489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:35.314858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:35.315147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:35.315426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] PATH_INFO: `/v3/projects/6d338516acd04d069fb897ccf1a10e89` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:35.316646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d338516acd04d069fb897ccf1a10e89)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:35.318770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:35.447318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d338516acd04d069fb897ccf1a10e89', 'request_id': 'req-c57b0576-16b5-4310-b935-bcfdf7221a1d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:35.533340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d338516acd04d069fb897ccf1a10e89', 'request_id': 'req-c57b0576-16b5-4310-b935-bcfdf7221a1d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:35.543044 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d338516acd04d069fb897ccf1a10e89', 'request_id': 'req-c57b0576-16b5-4310-b935-bcfdf7221a1d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:35.555830 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] The token cache is being invalidate because project 6d338516acd04d069fb897ccf1a10e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:35.556257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:35.556781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:35.558391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1115/2225] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:35 2022] DELETE /identity/v3/projects/6d338516acd04d069fb897ccf1a10e89 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:35.562375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:35.564308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:35.588617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af44ac0-2579-4983-b495-e33990bc7c3e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:35.665997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:35.666889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:35.667170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:35.667444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] PATH_INFO: `/v3/users/37c43796356346028ef9138464e249ff` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:35.668804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c43796356346028ef9138464e249ff)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:35.673921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:36.078303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c43796356346028ef9138464e249ff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:36.078303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c43796356346028ef9138464e249ff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:36.078303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c43796356346028ef9138464e249ff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:36.084949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c43796356346028ef9138464e249ff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:36.084949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-aa28bff8-cabf-41a3-9b05-6b01134f7f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c43796356346028ef9138464e249ff'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:36.445095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1111/2226] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:35 2022] DELETE /identity/v3/users/37c43796356346028ef9138464e249ff => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:12:36.760669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:36.763348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:36.792573 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b0576-16b5-4310-b935-bcfdf7221a1d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:36.861103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:36.862038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:36.862395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:36.862748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] PATH_INFO: `/v3/projects/948226c2d05645348f0250369ffdef06` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:36.864034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948226c2d05645348f0250369ffdef06)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:36.866059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:37.012546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948226c2d05645348f0250369ffdef06', 'request_id': 'req-5253ff0b-5b1b-4ab7-a86f-85b321467591'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:37.150281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948226c2d05645348f0250369ffdef06', 'request_id': 'req-5253ff0b-5b1b-4ab7-a86f-85b321467591'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:37.158115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948226c2d05645348f0250369ffdef06', 'request_id': 'req-5253ff0b-5b1b-4ab7-a86f-85b321467591'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:37.172567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] The token cache is being invalidate because project 948226c2d05645348f0250369ffdef06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:37.173341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:37.174331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5253ff0b-5b1b-4ab7-a86f-85b321467591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:37.176366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1116/2227] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:36 2022] DELETE /identity/v3/projects/948226c2d05645348f0250369ffdef06 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:12:37.184112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.185344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.185794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.227010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:37.228771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:37.326025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1112/2228] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:37.334858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748205d3-c187-4941-a9ab-56113098870b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.337442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748205d3-c187-4941-a9ab-56113098870b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.337442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748205d3-c187-4941-a9ab-56113098870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.365921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-748205d3-c187-4941-a9ab-56113098870b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:37.365921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-748205d3-c187-4941-a9ab-56113098870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:37.379178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1117/2229] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:37.379997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:37.392641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c385c4-71f9-47da-80c9-9741849b1025 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:37.397798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:37.403543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.403543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.403543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.403543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:12:37.403543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:37.403543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:37.421937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1113/2230] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:12:37.423375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748205d3-c187-4941-a9ab-56113098870b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:37.435989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748205d3-c187-4941-a9ab-56113098870b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:37.445752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:37.446495 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.446781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.447060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.448199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:37.450378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:37.579005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1118/2231] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:12:37 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:12:37.580288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:37.591809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f6523-03da-4906-bc15-0fc3aad35334 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:37.686977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:37.688456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.689039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.689489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.697590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:37.699924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:37.827874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1114/2232] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:12:37 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:12:37.839163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:37.850089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6673d8cf-6bce-46e7-a521-4ec6ee7c5b55 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:37.855409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:37.856205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.856607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.856942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.857781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:37.870844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:37.874010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1119/2233] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:37.877636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:37.893095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ea863-5577-4438-b14b-a021018c2b18 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:37.899696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f08eb6-09c9-4ead-896e-ffddacdd4e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:37.900383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08eb6-09c9-4ead-896e-ffddacdd4e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.900670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08eb6-09c9-4ead-896e-ffddacdd4e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.900940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08eb6-09c9-4ead-896e-ffddacdd4e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.901670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f08eb6-09c9-4ead-896e-ffddacdd4e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:37.912098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f08eb6-09c9-4ead-896e-ffddacdd4e05 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:37.914950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1115/2234] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:37.919625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:37.930722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc203859-cf9c-46dc-b52d-5388d54898e4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:37.935873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:37.939394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:37.939394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:37.939394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] PATH_INFO: `/v3/projects/31c2630bf71c4b1cb026fcbc7a06aa3e/users/71467473ea824157b880703475b49745/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:37.956332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c2630bf71c4b1cb026fcbc7a06aa3e, user_id=71467473ea824157b880703475b49745, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:37.959389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:38.104371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1120/2235] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:37 2022] PUT /identity/v3/projects/31c2630bf71c4b1cb026fcbc7a06aa3e/users/71467473ea824157b880703475b49745/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:38.113931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.114952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.115630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.146077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] MFA Rules not processed for user `71467473ea824157b880703475b49745`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:38.147554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:38.223101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1116/2236] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:38.224295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:38.291630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b3c5a-5756-405f-84b5-d4daf6068aba admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:38.296330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:38.296992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.297847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.298162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.298877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:38.300764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:38.380968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1121/2237] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:12:38 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:12:38.385193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:38.396180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a6f7b-e64c-4cca-8d3b-ae3e123f36a5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:38.461679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:38.462831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.463272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.463545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.464229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:38.466377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:38.606553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1117/2238] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:12:38 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:12:38.607788 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:38.619269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d78ad5-a378-473c-acfd-0759c7fed9f1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:38.623963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:38.624628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.624915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.625226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.626009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:38.627603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:38.639413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1122/2239] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:38.643767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:38.654442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d03beb-acd5-496d-8977-3c9de4ebbf83 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:38.659787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db573427-bcac-4092-9f01-f33284ad9a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:38.660456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db573427-bcac-4092-9f01-f33284ad9a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.660736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db573427-bcac-4092-9f01-f33284ad9a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.661015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db573427-bcac-4092-9f01-f33284ad9a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.661736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db573427-bcac-4092-9f01-f33284ad9a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:38.663703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db573427-bcac-4092-9f01-f33284ad9a59 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:38.674640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1118/2240] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:38.678874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:38.689469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb9929-43f1-43b4-a3bc-14441509965e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:38.694339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:38.695290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.695603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.695890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] PATH_INFO: `/v3/projects/944ea909b68e41c5a345b6d8fe3e4342/users/0ef9236ca4e04d1ea184bcec57d3b40c/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.710530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=944ea909b68e41c5a345b6d8fe3e4342, user_id=0ef9236ca4e04d1ea184bcec57d3b40c, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:38.713187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:38.853950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1123/2241] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:38 2022] PUT /identity/v3/projects/944ea909b68e41c5a345b6d8fe3e4342/users/0ef9236ca4e04d1ea184bcec57d3b40c/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:38.864923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:38.865878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:38.865878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:38.916467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] MFA Rules not processed for user `0ef9236ca4e04d1ea184bcec57d3b40c`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:38.917989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:39.001360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1119/2242] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:39.005196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.124629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd145f-3957-4866-9ada-4f5e718d5f1b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:39.130314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:39.131108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.131492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.132255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.132715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:39.138047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:39.229775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1124/2243] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:12:39 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:12:39.230939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.241793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca0a57-3e29-4beb-b743-c4a4a4168f99 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:39.299718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:39.300568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.300948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.301338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.302162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:39.304180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:39.403112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1120/2244] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:12:39 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:12:39.407002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.418785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460817f4-84eb-4161-9996-cbdced5b021a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:39.424007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:39.425147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.425147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.429998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.429998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:39.429998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:39.457217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1125/2245] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:12:39.461207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.472776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2e798-ca90-4445-8d01-96db2f23f48d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:39.479240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:39.480213 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.480570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.480879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] PATH_INFO: `/v3/projects/452cbe57c87043369b406ce02bd27edf/users/96ed9239be2d40f8999b0dde2a4a764c/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.498214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] RBAC: Authorizing `identity:create_grant(project_id=452cbe57c87043369b406ce02bd27edf, user_id=96ed9239be2d40f8999b0dde2a4a764c, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:39.501859 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:39.574715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1121/2246] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:39 2022] PUT /identity/v3/projects/452cbe57c87043369b406ce02bd27edf/users/96ed9239be2d40f8999b0dde2a4a764c/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:12:39.578795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.596116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0c8a-913a-4553-a6ad-4717f906cd7f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:39.682186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3432bcd-bee1-4c0d-b130-11e941046685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:39.682862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3432bcd-bee1-4c0d-b130-11e941046685 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.683148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3432bcd-bee1-4c0d-b130-11e941046685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.683563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3432bcd-bee1-4c0d-b130-11e941046685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.684289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3432bcd-bee1-4c0d-b130-11e941046685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:39.685947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3432bcd-bee1-4c0d-b130-11e941046685 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:39.696387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1126/2247] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:12:39.700614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.714062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287df725-9495-4576-bee8-8cb0efc2362b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:39.717342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:39.718313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.718596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.718907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] PATH_INFO: `/v3/projects/452cbe57c87043369b406ce02bd27edf/users/96ed9239be2d40f8999b0dde2a4a764c/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.721032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=452cbe57c87043369b406ce02bd27edf, user_id=96ed9239be2d40f8999b0dde2a4a764c, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:39.723758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:39.739792 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1122/2248] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:12:39 2022] PUT /identity/v3/projects/452cbe57c87043369b406ce02bd27edf/users/96ed9239be2d40f8999b0dde2a4a764c/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:39.751542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:39.751849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:39.752273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:39.781455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] MFA Rules not processed for user `96ed9239be2d40f8999b0dde2a4a764c`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:39.782862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:39.891570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1127/2249] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:39.901768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:39.903633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:40.040415 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401feef7-1b17-40fa-a6e6-436b57769f22 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:40.045080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:40.045869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:40.046258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:40.046584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:40.129179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:40.130766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:40.148526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1123/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:42.312118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:42.313510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:42.325319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5e55-e45d-47e6-80a9-ba29ff74b055 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:42.329274 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:42.330156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:42.330441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:42.330716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:42.389814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:42.391321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:42.400575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1128/2251] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:44.074166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:44.082954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eb8c2-da92-4252-b8d3-84ab9754cf2d service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:44.087222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1b9be-1384-4ef8-bd08-4dabf3fc704f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:44.087941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b9be-1384-4ef8-bd08-4dabf3fc704f service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:44.088290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b9be-1384-4ef8-bd08-4dabf3fc704f service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:44.088632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1b9be-1384-4ef8-bd08-4dabf3fc704f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:44.098172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1b9be-1384-4ef8-bd08-4dabf3fc704f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:44.102837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1b9be-1384-4ef8-bd08-4dabf3fc704f service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:44.109760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1124/2252] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:48.849694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:48.910393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbe188-2ee9-4b6d-b3a5-b72a81e71441 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:48.915126 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:48.915982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:48.916267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:48.916543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] PATH_INFO: `/v3/users/71467473ea824157b880703475b49745` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:48.917735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71467473ea824157b880703475b49745)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:48.919665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:49.216821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71467473ea824157b880703475b49745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:49.218051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71467473ea824157b880703475b49745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:49.218726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71467473ea824157b880703475b49745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:49.304554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71467473ea824157b880703475b49745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:49.311879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71467473ea824157b880703475b49745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:49.330122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1129/2253] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:48 2022] DELETE /identity/v3/users/71467473ea824157b880703475b49745 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:49.335072 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:49.335832 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:49.336132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:49.353533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:49.354835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:49.417056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1125/2254] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:49.427055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:49.428452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:49.488010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56876ff7-9594-47f6-9bb2-e5894eea66a8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:49.491623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:49.492351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:49.492632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:49.492910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:49.501820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:49.503819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:49.513077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1130/2255] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:12:49.957177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:49.958803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:49.971445 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a94d-9164-4975-a2a6-0748fc9bd879 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:49.976182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:49.977049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:49.977332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:49.977764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] PATH_INFO: `/v3/projects/31c2630bf71c4b1cb026fcbc7a06aa3e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:49.978994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c2630bf71c4b1cb026fcbc7a06aa3e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:49.980945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:50.126074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c2630bf71c4b1cb026fcbc7a06aa3e', 'request_id': 'req-f65e43f7-0dc4-4f15-b113-a3bad4151912'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.131171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c2630bf71c4b1cb026fcbc7a06aa3e', 'request_id': 'req-f65e43f7-0dc4-4f15-b113-a3bad4151912'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.137074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c2630bf71c4b1cb026fcbc7a06aa3e', 'request_id': 'req-f65e43f7-0dc4-4f15-b113-a3bad4151912'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.211766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] The token cache is being invalidate because project 31c2630bf71c4b1cb026fcbc7a06aa3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:50.212047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.212674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.214309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1126/2256] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:49 2022] DELETE /identity/v3/projects/31c2630bf71c4b1cb026fcbc7a06aa3e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:50.218422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:50.228492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5697b3-ae23-43ef-a6c6-494038efd77b service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:50.285051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:50.285806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:50.286164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:50.286446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] PATH_INFO: `/v3/users/0ef9236ca4e04d1ea184bcec57d3b40c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:50.287889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef9236ca4e04d1ea184bcec57d3b40c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:50.289837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:50.501108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef9236ca4e04d1ea184bcec57d3b40c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.502293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef9236ca4e04d1ea184bcec57d3b40c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.502960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef9236ca4e04d1ea184bcec57d3b40c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.572953 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef9236ca4e04d1ea184bcec57d3b40c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.581335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef9236ca4e04d1ea184bcec57d3b40c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:50.599006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1131/2257] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:50 2022] DELETE /identity/v3/users/0ef9236ca4e04d1ea184bcec57d3b40c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:51.146035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:51.148368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:51.172829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e43f7-0dc4-4f15-b113-a3bad4151912 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:51.234650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:51.235543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:51.235821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:51.236090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] PATH_INFO: `/v3/projects/944ea909b68e41c5a345b6d8fe3e4342` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:51.237932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944ea909b68e41c5a345b6d8fe3e4342)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:51.239902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:51.344488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944ea909b68e41c5a345b6d8fe3e4342', 'request_id': 'req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.355275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944ea909b68e41c5a345b6d8fe3e4342', 'request_id': 'req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.357166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944ea909b68e41c5a345b6d8fe3e4342', 'request_id': 'req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.430191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] The token cache is being invalidate because project 944ea909b68e41c5a345b6d8fe3e4342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:51.430478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.431092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.432805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1127/2258] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:51 2022] DELETE /identity/v3/projects/944ea909b68e41c5a345b6d8fe3e4342 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:51.442851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:51.442851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:51.454738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901cd08-dcb9-4873-b020-b317ca61e4dc admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:51.522077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:51.522077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:51.522077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:51.522077 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] PATH_INFO: `/v3/users/96ed9239be2d40f8999b0dde2a4a764c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:51.522556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ed9239be2d40f8999b0dde2a4a764c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:51.522849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:51.689828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ed9239be2d40f8999b0dde2a4a764c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.690521 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ed9239be2d40f8999b0dde2a4a764c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.691142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ed9239be2d40f8999b0dde2a4a764c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.744360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ed9239be2d40f8999b0dde2a4a764c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.752028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-16d67702-7210-4569-9cca-b61cff4a1e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ed9239be2d40f8999b0dde2a4a764c'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:51.769670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1132/2259] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:51 2022] DELETE /identity/v3/users/96ed9239be2d40f8999b0dde2a4a764c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:52.237517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:52.239097 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:52.254188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0106a7-64fe-4cb5-ac5d-79cb9c5de252 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:52.311740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:52.312597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:52.312877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:52.313149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] PATH_INFO: `/v3/projects/452cbe57c87043369b406ce02bd27edf` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:52.314902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=452cbe57c87043369b406ce02bd27edf)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:52.316844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:52.435313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '452cbe57c87043369b406ce02bd27edf', 'request_id': 'req-f80b427b-06f9-4bab-bf48-617f5957c9d6'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:52.441356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '452cbe57c87043369b406ce02bd27edf', 'request_id': 'req-f80b427b-06f9-4bab-bf48-617f5957c9d6'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:52.448508 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '452cbe57c87043369b406ce02bd27edf', 'request_id': 'req-f80b427b-06f9-4bab-bf48-617f5957c9d6'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:52.578130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] The token cache is being invalidate because project 452cbe57c87043369b406ce02bd27edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:12:52.578369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:52.578983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:52.580636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1128/2260] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:12:52 2022] DELETE /identity/v3/projects/452cbe57c87043369b406ce02bd27edf => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:12:56.612839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:56.613297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:56.613392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:56.631132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:12:56.632342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:56.692431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1133/2261] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:12:56.735253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:56.736691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:56.803200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b427b-06f9-4bab-bf48-617f5957c9d6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:56.808302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2cb143-01cf-48a7-868a-b79dbf9c8966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:56.808891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb143-01cf-48a7-868a-b79dbf9c8966 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:56.809176 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb143-01cf-48a7-868a-b79dbf9c8966 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:56.809454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2cb143-01cf-48a7-868a-b79dbf9c8966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:56.817503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cb143-01cf-48a7-868a-b79dbf9c8966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:56.819920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2cb143-01cf-48a7-868a-b79dbf9c8966 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:56.826994 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1129/2262] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:12:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:12:59.681881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:12:59.683356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:12:59.765901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af8da2-4418-4bd7-9b00-e5803ef93d83 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:12:59.770389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:12:59.771247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:12:59.771522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:12:59.771791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] PATH_INFO: `/v3/users/3e2dc142d2e945dbaaf917e7770ef150` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:12:59.773316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2dc142d2e945dbaaf917e7770ef150)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:12:59.775055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:12:59.976595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2dc142d2e945dbaaf917e7770ef150'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:59.977555 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2dc142d2e945dbaaf917e7770ef150'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:12:59.978626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2dc142d2e945dbaaf917e7770ef150'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:00.058619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2dc142d2e945dbaaf917e7770ef150'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:00.067458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2dc142d2e945dbaaf917e7770ef150'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:00.087093 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1134/2263] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:12:59 2022] DELETE /identity/v3/users/3e2dc142d2e945dbaaf917e7770ef150 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:00.091550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:00.093277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:00.093277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:00.116700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:00.118336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:00.184851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1130/2264] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:13:00.191855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:00.193395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:00.256632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f755e-a77f-4385-b9fd-9373638d4485 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:00.261337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcda36-dd4b-479d-b881-fb855f4fac37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:00.262014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcda36-dd4b-479d-b881-fb855f4fac37 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:00.262360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcda36-dd4b-479d-b881-fb855f4fac37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:00.262576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcda36-dd4b-479d-b881-fb855f4fac37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:00.272988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcda36-dd4b-479d-b881-fb855f4fac37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:00.274831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcda36-dd4b-479d-b881-fb855f4fac37 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:00.286840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1135/2265] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:00.776308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:00.777860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:00.792869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7700-d9fb-4ec0-bf88-a8ed7b83fb7e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:00.803894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:00.804774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:00.805069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:00.805327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] PATH_INFO: `/v3/projects/e15d306ded554d27a558ae32f9d432e9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:00.806571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15d306ded554d27a558ae32f9d432e9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:00.809373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:00.901276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15d306ded554d27a558ae32f9d432e9', 'request_id': 'req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:00.908491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15d306ded554d27a558ae32f9d432e9', 'request_id': 'req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:00.915553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15d306ded554d27a558ae32f9d432e9', 'request_id': 'req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:01.002247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] The token cache is being invalidate because project e15d306ded554d27a558ae32f9d432e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:13:01.003345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:01.004120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e37e5bc0-0b1c-4e26-9397-46f7cd08f9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:01.006204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1131/2266] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:13:00 2022] DELETE /identity/v3/projects/e15d306ded554d27a558ae32f9d432e9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:01.010886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.011422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.011556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.030754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:01.031880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:01.098375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1136/2267] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:01.106564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.107242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.107242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.125960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:01.127567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:01.136510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1132/2268] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:01.141935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.155537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100bd13-de5b-4f72-984c-83938fa94c77 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.163387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.164577 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.164844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.165262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.166235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:13:01.166938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.168885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.184234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1137/2269] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:13:01.188780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.198811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfba38-7df1-47e6-8794-f00b10c8e5e4 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.204149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.205007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.205454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.205727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.206495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.208693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.323062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1133/2270] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:13:01 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:01.323915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.335552 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9be6e2-9a58-4981-be29-69e7f94614ea admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.402388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.403988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.404826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.405458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.406490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.409543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.475677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1138/2271] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:13:01 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:01.477948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.489425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798fcd6-db1a-472b-9514-3bfeb6732a32 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.494363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.495214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.495654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.496099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.496997 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.498875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.510065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1134/2272] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:01.514241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.527805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c9f99-7d69-4e1c-953d-90478ea18bb9 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.532952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218834cb-3742-4d71-a7b1-a7abe0a1bf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.533746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218834cb-3742-4d71-a7b1-a7abe0a1bf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.534753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218834cb-3742-4d71-a7b1-a7abe0a1bf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.535172 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218834cb-3742-4d71-a7b1-a7abe0a1bf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.535893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218834cb-3742-4d71-a7b1-a7abe0a1bf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.537591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218834cb-3742-4d71-a7b1-a7abe0a1bf83 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.549210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1139/2273] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:01.553120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.563662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe86f1-210c-45ad-9691-eb5d0fa0f2a5 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.570001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.571028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.571524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.572056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] PATH_INFO: `/v3/projects/2fef6b53f8794ce3acf225bc18f41292/users/10bd3833ec1248d9abdf96a9a4a25af0/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.588279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fef6b53f8794ce3acf225bc18f41292, user_id=10bd3833ec1248d9abdf96a9a4a25af0, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.591474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.712378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1135/2274] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:13:01 2022] PUT /identity/v3/projects/2fef6b53f8794ce3acf225bc18f41292/users/10bd3833ec1248d9abdf96a9a4a25af0/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:13:01.714637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32e251-d3ca-4b38-b195-2ad5e0c5f0ec None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.715663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32e251-d3ca-4b38-b195-2ad5e0c5f0ec None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.716038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32e251-d3ca-4b38-b195-2ad5e0c5f0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.747095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6a32e251-d3ca-4b38-b195-2ad5e0c5f0ec None None] MFA Rules not processed for user `10bd3833ec1248d9abdf96a9a4a25af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:01.748411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6a32e251-d3ca-4b38-b195-2ad5e0c5f0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:01.822765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1140/2275] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:01.834657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:01.836715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:01.900969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d168ba6-cd7b-41e3-ac0b-2ecea07d2914 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:01.905185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:01.905844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:01.906162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:01.906439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:01.916252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:01.917780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:01.927829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1136/2276] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:03.661243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0b37-8ec9-4356-9e87-74b3aca5aa17 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:03.661866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0b37-8ec9-4356-9e87-74b3aca5aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:03.661866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0b37-8ec9-4356-9e87-74b3aca5aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:03.681260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b9bb0b37-8ec9-4356-9e87-74b3aca5aa17 None None] MFA Rules not processed for user `10bd3833ec1248d9abdf96a9a4a25af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:03.682553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b9bb0b37-8ec9-4356-9e87-74b3aca5aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:03.689951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1141/2277] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:12.936631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:12.938118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:13.026350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799966e2-3e26-457c-9c61-33df2051dd02 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:13.031342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952f39b205c74255a2776e7fec3b8643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:13.031975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:13.032251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:13.032521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:13.034748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:13.045722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:13.047341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:13.058106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1137/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:14.106038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:14.106543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:14.106543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:14.154594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:14.155857 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:14.219874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1142/2279] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 26 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:14.232290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:14.233639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:14.317798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7a523-764d-4fdd-8176-182beb954b4b service placement] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:14.323016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:14.323758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:14.324039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:14.324312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:14.332139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:14.333735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:14.343760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1138/2280] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:13:17.395763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:17.397256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:17.464819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35020c7-e4e3-4669-961c-19b10b1145b8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:17.469331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:17.470223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:17.470506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:17.470781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] PATH_INFO: `/v3/users/0b6057ad951e418a9d60de92517ae089` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:17.472464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6057ad951e418a9d60de92517ae089)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:17.474426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:17.673256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6057ad951e418a9d60de92517ae089'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:17.673829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6057ad951e418a9d60de92517ae089'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:17.674541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6057ad951e418a9d60de92517ae089'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:17.732099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6057ad951e418a9d60de92517ae089'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:17.738826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-bf895f42-4206-436c-b6bc-402270aed7d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6057ad951e418a9d60de92517ae089'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:17.756380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1143/2281] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:13:17 2022] DELETE /identity/v3/users/0b6057ad951e418a9d60de92517ae089 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:18.020290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.031784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048ec1-9f9a-4684-b321-16e64c8c5ac7 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.095190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.096053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.096328 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.096597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] PATH_INFO: `/v3/projects/e9ba0d67b78f4c59b3d8e1ea5ae2895d` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.097800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ba0d67b78f4c59b3d8e1ea5ae2895d)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.099750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:18.245735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'request_id': 'req-8fdb38ea-3278-4faa-ad98-19c09dee6728'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:18.250927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'request_id': 'req-8fdb38ea-3278-4faa-ad98-19c09dee6728'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:18.257291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'request_id': 'req-8fdb38ea-3278-4faa-ad98-19c09dee6728'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:18.314586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] The token cache is being invalidate because project e9ba0d67b78f4c59b3d8e1ea5ae2895d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:13:18.314808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:18.315426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8fdb38ea-3278-4faa-ad98-19c09dee6728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:18.317488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1139/2282] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:13:18 2022] DELETE /identity/v3/projects/e9ba0d67b78f4c59b3d8e1ea5ae2895d => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:13:18.322319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.322613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.322892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.341493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:18.342824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:18.401009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1144/2283] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:18.408625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.408912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.409189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.427686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:18.428887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:18.437392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1140/2284] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:18.442300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.452758 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502ac2c-c46c-4927-bbb5-ff5fe709bb4d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.457668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.458361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.458645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.458918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.459642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:13:18.459947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.461556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:18.473337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1145/2285] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:13:18.477727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.486982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0f576-c856-4daf-9d9c-465f6ce0ddb4 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.492838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.493489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.493772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.494078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.494771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.496707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:18.594333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1141/2286] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:13:18 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:18.600427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.605478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33941e-25cc-4525-9e9f-0c74f292f146 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.658972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.659667 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.659933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.660207 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.660883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.663155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:18.795206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1146/2287] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:13:18 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:18.799423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.809995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49444763-13b5-4693-bcd2-47788a1d0354 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.814493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.815149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.815443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.815703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.816420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.818036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:18.838060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1142/2288] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:18.841672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.852748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a43ad7-6a72-4dcf-8bac-be168147e95c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.857475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba9b56-e0ca-41fd-ad23-7e2e942e0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.858283 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9b56-e0ca-41fd-ad23-7e2e942e0dab admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.858566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9b56-e0ca-41fd-ad23-7e2e942e0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.858839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9b56-e0ca-41fd-ad23-7e2e942e0dab admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.859564 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba9b56-e0ca-41fd-ad23-7e2e942e0dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.861175 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba9b56-e0ca-41fd-ad23-7e2e942e0dab admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:18.871656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1147/2289] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:18.875829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:18.885589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aeb39-111b-4e6b-a303-7500cf3b224e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:18.890303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:18.891259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:18.891540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:18.891811 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] PATH_INFO: `/v3/projects/b413f61cf3e2482aa4cd52f07ceece16/users/4406a30fba8e49df854cbacc3e0997ff/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:18.906007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b413f61cf3e2482aa4cd52f07ceece16, user_id=4406a30fba8e49df854cbacc3e0997ff, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:18.908758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:19.001420 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1143/2290] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:13:18 2022] PUT /identity/v3/projects/b413f61cf3e2482aa4cd52f07ceece16/users/4406a30fba8e49df854cbacc3e0997ff/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:19.011402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787c386-c17d-41dd-9c68-ab80a39826a1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:19.011699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787c386-c17d-41dd-9c68-ab80a39826a1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:19.011979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787c386-c17d-41dd-9c68-ab80a39826a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:19.039821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1787c386-c17d-41dd-9c68-ab80a39826a1 None None] MFA Rules not processed for user `4406a30fba8e49df854cbacc3e0997ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:19.041060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1787c386-c17d-41dd-9c68-ab80a39826a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:19.106228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1148/2291] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:19.118816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:19.120663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:19.199458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b7c01-e5c0-4c5a-9117-f048ba37c981 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:19.203167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:19.203806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:19.204089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:19.204371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:19.213076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:19.214563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:19.223980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1144/2292] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:22.644416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705772a-9880-4cca-af24-5b3cbc1acdcf None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:22.644870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705772a-9880-4cca-af24-5b3cbc1acdcf None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:22.644964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705772a-9880-4cca-af24-5b3cbc1acdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:22.664678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1705772a-9880-4cca-af24-5b3cbc1acdcf None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:22.666352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1705772a-9880-4cca-af24-5b3cbc1acdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:22.720069 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1149/2293] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:22.732746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:22.734171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:22.806315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb668-ca56-496d-9b53-ac6179fd8ec5 service glance] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:22.811326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:22.811969 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:22.812253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:22.812528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:22.820340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:22.823886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:22.829729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1145/2294] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:13:23.852226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d9bca-5029-4d90-b159-a76c161bda5f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:23.852672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d9bca-5029-4d90-b159-a76c161bda5f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:23.852771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d9bca-5029-4d90-b159-a76c161bda5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:23.870518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-f18d9bca-5029-4d90-b159-a76c161bda5f None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:23.871707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f18d9bca-5029-4d90-b159-a76c161bda5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:23.878785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1150/2295] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 26 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:23.891569 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:23.901738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e2afc-51f6-4ed8-8c0b-d6d3e6c0ad28 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:23.906821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:23.907562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:23.907824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:23.908249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:23.917814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:23.922497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:23.931073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1146/2296] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:13:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:13:24.581959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87817df-9144-4dce-a26f-8a09e2e19268 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:24.582870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87817df-9144-4dce-a26f-8a09e2e19268 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:24.592671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87817df-9144-4dce-a26f-8a09e2e19268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:24.603645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d87817df-9144-4dce-a26f-8a09e2e19268 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:24.605129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d87817df-9144-4dce-a26f-8a09e2e19268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:24.612367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1151/2297] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:24.624360 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:24.634766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e369c3-784a-41a2-8f4f-868329ff5de9 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:24.639772 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:24.640416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:24.640701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:24.640982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:24.650111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:24.651423 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:24.659656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1147/2298] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:13:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:13:25.372951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:25.373420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:25.377850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:25.393532 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:25.394812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:25.402245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1152/2299] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 26 14:13:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:25.420967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:25.425303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e81115-cdbe-4f26-9a38-b4c20f815ddc service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:25.430958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36bde7-c157-48bf-9de0-8993eb1a3b9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:25.431592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36bde7-c157-48bf-9de0-8993eb1a3b9f service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:25.431874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36bde7-c157-48bf-9de0-8993eb1a3b9f service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:25.432146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36bde7-c157-48bf-9de0-8993eb1a3b9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:25.442156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36bde7-c157-48bf-9de0-8993eb1a3b9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:25.442670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36bde7-c157-48bf-9de0-8993eb1a3b9f service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:25.450858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1148/2300] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:13:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:13:28.223766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:28.225263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:28.297508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25837d7d-cc72-457b-92a8-8b2822b0d65f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:28.302503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:28.303378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:28.303657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:28.303930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] PATH_INFO: `/v3/users/10bd3833ec1248d9abdf96a9a4a25af0` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:28.305155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bd3833ec1248d9abdf96a9a4a25af0)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:28.307122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:28.513829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bd3833ec1248d9abdf96a9a4a25af0'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:28.515370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bd3833ec1248d9abdf96a9a4a25af0'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:28.515370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bd3833ec1248d9abdf96a9a4a25af0'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:28.572491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bd3833ec1248d9abdf96a9a4a25af0'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:28.580053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bd3833ec1248d9abdf96a9a4a25af0'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:28.597522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1153/2301] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:13:28 2022] DELETE /identity/v3/users/10bd3833ec1248d9abdf96a9a4a25af0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:28.602944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:28.603349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:28.603542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:28.621484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:28.622735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:28.679933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1149/2302] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:13:28.689420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:28.690905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:28.745762 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ca57-f95d-48c2-bd4b-339921ccf6a4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:28.750063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ae943-30ca-4814-b869-d46044ebc88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:28.750705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae943-30ca-4814-b869-d46044ebc88f service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:28.750989 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae943-30ca-4814-b869-d46044ebc88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:28.751267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ae943-30ca-4814-b869-d46044ebc88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:28.762013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae943-30ca-4814-b869-d46044ebc88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:28.763462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ae943-30ca-4814-b869-d46044ebc88f service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:28.773092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1154/2303] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:28.991255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:28.993263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:29.009151 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96844e-e42d-422a-a38d-e125d2cf58f2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.015618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.016805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.024049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.024049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] PATH_INFO: `/v3/projects/2fef6b53f8794ce3acf225bc18f41292` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.024049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fef6b53f8794ce3acf225bc18f41292)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.024049 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.149697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fef6b53f8794ce3acf225bc18f41292', 'request_id': 'req-810df2a4-71ce-4faa-9077-9fd39abf89bf'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:29.155023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fef6b53f8794ce3acf225bc18f41292', 'request_id': 'req-810df2a4-71ce-4faa-9077-9fd39abf89bf'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:29.161647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fef6b53f8794ce3acf225bc18f41292', 'request_id': 'req-810df2a4-71ce-4faa-9077-9fd39abf89bf'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:29.217901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] The token cache is being invalidate because project 2fef6b53f8794ce3acf225bc18f41292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:13:29.218245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:29.218871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-810df2a4-71ce-4faa-9077-9fd39abf89bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:29.220456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1150/2304] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:13:28 2022] DELETE /identity/v3/projects/2fef6b53f8794ce3acf225bc18f41292 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:29.225962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.226491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.226611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.244262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:29.245466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:29.304785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1155/2305] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:29.312462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.312752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.313033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.333062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:29.334303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:29.342241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1151/2306] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:29.346317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:29.356104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5e744-097e-4498-aac4-e822c267cf47 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.360585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.361226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.361505 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.361777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.362567 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:13:29.362868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.364464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.376105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1156/2307] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:13:29.381107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:29.390442 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498abd5-0a82-48a7-88d2-eb7f73a0eb1b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.395688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.396306 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.396584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.396862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.397544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.399866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.506248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1152/2308] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:13:29 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:29.510082 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:29.521070 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c218ba-2ca0-478b-9a20-f96c251cbbde admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.578868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.579593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.579812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.580170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.580826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.583437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.727582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1157/2309] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:13:29 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:29.731794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:29.742335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e4ff7-690e-4a26-8c7b-a1a0786c7883 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.746822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.747466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.747743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.748019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.748736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.750364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.760914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1153/2310] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:13:29.764837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:29.775109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedef41-5b56-4a71-b510-2788091ba2b8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.779815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c61e3-d13b-4341-bbea-8db25d3d9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.780469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c61e3-d13b-4341-bbea-8db25d3d9684 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.780759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c61e3-d13b-4341-bbea-8db25d3d9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.781039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c61e3-d13b-4341-bbea-8db25d3d9684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.781773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c61e3-d13b-4341-bbea-8db25d3d9684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.783450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c61e3-d13b-4341-bbea-8db25d3d9684 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.793524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1158/2311] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:29.797706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:29.808356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a3bb7-c494-4684-a633-f1117bb09bec admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:29.813352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:29.814298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.814577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.814847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] PATH_INFO: `/v3/projects/044c341dbfb24ed2812bc91e85e6b06a/users/434acf8f6a44484189c95c3504418e20/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.830486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=044c341dbfb24ed2812bc91e85e6b06a, user_id=434acf8f6a44484189c95c3504418e20, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:29.833141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:29.961648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1154/2312] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:13:29 2022] PUT /identity/v3/projects/044c341dbfb24ed2812bc91e85e6b06a/users/434acf8f6a44484189c95c3504418e20/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:29.966905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dbc60-aa56-4daa-9aa3-b7d456e904b3 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:29.967197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dbc60-aa56-4daa-9aa3-b7d456e904b3 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:29.967477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dbc60-aa56-4daa-9aa3-b7d456e904b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:29.985460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-c88dbc60-aa56-4daa-9aa3-b7d456e904b3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:29.986642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c88dbc60-aa56-4daa-9aa3-b7d456e904b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:30.044459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1159/2313] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:13:30.054618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:30.056399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:30.109332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c76a2-af9b-4536-b949-a1262014e7bc admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:30.114551 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:30.115188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:30.115471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:30.115748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:30.124929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:30.126394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:30.137897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1155/2314] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:31.407167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111ca0-e21b-4ea4-877d-aad78670370f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:31.407684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111ca0-e21b-4ea4-877d-aad78670370f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:31.407783 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78111ca0-e21b-4ea4-877d-aad78670370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:31.438520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-78111ca0-e21b-4ea4-877d-aad78670370f None None] MFA Rules not processed for user `434acf8f6a44484189c95c3504418e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:31.439889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-78111ca0-e21b-4ea4-877d-aad78670370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:31.507903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1160/2315] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:31.519259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:31.520710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:31.575804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cff017-a679-4695-b5fe-26e521df643c service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:31.579520 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3234c81-c5b3-4496-9bcf-1e4dcf557dbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:31.580162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3234c81-c5b3-4496-9bcf-1e4dcf557dbd service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:31.580472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3234c81-c5b3-4496-9bcf-1e4dcf557dbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:31.580739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3234c81-c5b3-4496-9bcf-1e4dcf557dbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:31.589160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3234c81-c5b3-4496-9bcf-1e4dcf557dbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:31.590562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3234c81-c5b3-4496-9bcf-1e4dcf557dbd service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:31.599521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1156/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:33.393319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:33.393838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:33.395240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:33.419606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] MFA Rules not processed for user `434acf8f6a44484189c95c3504418e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:33.420952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:33.429027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1161/2317] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:36.243020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f3e4-f412-40e6-b584-6e2f7eab9793 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:36.243554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f3e4-f412-40e6-b584-6e2f7eab9793 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:36.243554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f3e4-f412-40e6-b584-6e2f7eab9793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:36.264255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c105f3e4-f412-40e6-b584-6e2f7eab9793 None None] MFA Rules not processed for user `797d50f3ba6244f4a62b3abfa24410d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:36.265480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c105f3e4-f412-40e6-b584-6e2f7eab9793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:36.320489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1157/2318] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:50.897211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:50.898849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:50.916178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157e471-c036-4bad-9252-7d395ddd2f17 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:50.921101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:50.922002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:50.922265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:50.922539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] PATH_INFO: `/v3/users/4406a30fba8e49df854cbacc3e0997ff` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:50.923722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4406a30fba8e49df854cbacc3e0997ff)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:50.925776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:51.142741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4406a30fba8e49df854cbacc3e0997ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:51.143468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4406a30fba8e49df854cbacc3e0997ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:51.144148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4406a30fba8e49df854cbacc3e0997ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:51.212459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4406a30fba8e49df854cbacc3e0997ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:51.219928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4406a30fba8e49df854cbacc3e0997ff'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:51.237250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1162/2319] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:13:50 2022] DELETE /identity/v3/users/4406a30fba8e49df854cbacc3e0997ff => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:51.241856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:51.242401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:51.242507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:51.260739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:51.262124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:51.324305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1158/2320] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:51.335782 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:51.337292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:51.405958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d18efe-9fcb-4056-ab90-e38ac8cd89b4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:51.410522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf02e-2dad-4224-a364-3ca0aa203b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:51.411218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf02e-2dad-4224-a364-3ca0aa203b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:51.411479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf02e-2dad-4224-a364-3ca0aa203b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:51.411756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf02e-2dad-4224-a364-3ca0aa203b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:51.423158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf02e-2dad-4224-a364-3ca0aa203b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:51.424617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf02e-2dad-4224-a364-3ca0aa203b1e service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:51.442076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1163/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:51.854884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:51.856332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:51.869139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ad527-ffd6-4de9-a800-ab189008eb81 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:51.874161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:51.875027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:51.875331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:51.875603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] PATH_INFO: `/v3/projects/b413f61cf3e2482aa4cd52f07ceece16` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:51.876788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b413f61cf3e2482aa4cd52f07ceece16)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:51.878819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.017778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b413f61cf3e2482aa4cd52f07ceece16', 'request_id': 'req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:52.023871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b413f61cf3e2482aa4cd52f07ceece16', 'request_id': 'req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:52.030304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b413f61cf3e2482aa4cd52f07ceece16', 'request_id': 'req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:52.104601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] The token cache is being invalidate because project b413f61cf3e2482aa4cd52f07ceece16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:13:52.104892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:52.105547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d87d3e17-d38b-47a8-8ad1-91b15b6f84fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:52.107116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1159/2322] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:13:51 2022] DELETE /identity/v3/projects/b413f61cf3e2482aa4cd52f07ceece16 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:52.112080 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.112535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.112628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.130679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:52.131853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:52.191401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1164/2323] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:52.200822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.201125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.201398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.221082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:52.222315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:52.231094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1160/2324] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:52.235494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.245011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d85d2-5633-4e16-b12b-1e8406796925 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.249725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.250409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.250696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.250974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.251711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:13:52.252052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.253647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.265489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1165/2325] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:13:52.270027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.279615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b193e-391c-460d-a5f4-4bbf9b0594d2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.284260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.284907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.285190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.285474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.286875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.289035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.408735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1161/2326] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:13:52 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:13:52.413273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.423480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252262e-3a6a-4315-8d64-605d23b8e462 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.481428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.482193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.482617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.482756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.483468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.486007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.567079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1166/2327] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:13:52 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:13:52.571124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.581231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8796b2-55ca-49ff-a688-e1f90ae0fec3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.585813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.586507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.586789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.587066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.587788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.589515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.601116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1162/2328] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:52.605038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.615983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8577866-1b4c-464b-a801-c7fca6a8a94a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.620802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d3d3f-dd89-4022-b0a7-d0d8c924820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.621460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3d3f-dd89-4022-b0a7-d0d8c924820a admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.621747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3d3f-dd89-4022-b0a7-d0d8c924820a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.622067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d3d3f-dd89-4022-b0a7-d0d8c924820a admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.622802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d3d3f-dd89-4022-b0a7-d0d8c924820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.624408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d3d3f-dd89-4022-b0a7-d0d8c924820a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.634302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1167/2329] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:13:52.639212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.649416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b55f85-dd9c-4a63-9edd-3a2d7b9d35a2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.653873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.654799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.655076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.655346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] PATH_INFO: `/v3/projects/60b9bc7abb3247ebb10f655a103806e2/users/0745383881754784bcd55e3e032c5c72/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.670412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b9bc7abb3247ebb10f655a103806e2, user_id=0745383881754784bcd55e3e032c5c72, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.673450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.755366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1163/2330] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:13:52 2022] PUT /identity/v3/projects/60b9bc7abb3247ebb10f655a103806e2/users/0745383881754784bcd55e3e032c5c72/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:13:52.765507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.765798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.766110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.795259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] MFA Rules not processed for user `0745383881754784bcd55e3e032c5c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:52.796538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:52.866779 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1168/2331] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:52.874671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:52.876430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:52.935099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a36ab-bbd7-40ce-8b85-27a2cce7a1d7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:52.938853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3853eb-9784-4a5d-9005-ecdde50287df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:52.939488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3853eb-9784-4a5d-9005-ecdde50287df service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:52.939767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3853eb-9784-4a5d-9005-ecdde50287df service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:52.940039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3853eb-9784-4a5d-9005-ecdde50287df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:52.948037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3853eb-9784-4a5d-9005-ecdde50287df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:52.949460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3853eb-9784-4a5d-9005-ecdde50287df service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:52.959979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1164/2332] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:52.985271 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:53.049201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd0b51-859c-4ff1-b47a-adc31c767f88 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:53.053897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:53.054771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:53.055054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:53.055322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] PATH_INFO: `/v3/users/0745383881754784bcd55e3e032c5c72` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:53.056513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0745383881754784bcd55e3e032c5c72)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:53.058497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:53.260752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0745383881754784bcd55e3e032c5c72'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:53.261725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0745383881754784bcd55e3e032c5c72'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:53.262374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0745383881754784bcd55e3e032c5c72'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:53.360860 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0745383881754784bcd55e3e032c5c72'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:53.368623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0745383881754784bcd55e3e032c5c72'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:53.386429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1169/2333] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:13:52 2022] DELETE /identity/v3/users/0745383881754784bcd55e3e032c5c72 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:13:53.391122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:53.391618 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:53.391720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:53.409078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:13:53.410331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:53.473559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1165/2334] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:13:53.485017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:53.486466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:53.543656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703f989-8094-4662-bc34-805205810fc1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:53.547391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5595a9d-d72d-4192-b667-3d58ea51a98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:53.548050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595a9d-d72d-4192-b667-3d58ea51a98c service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:53.548398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595a9d-d72d-4192-b667-3d58ea51a98c service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:53.548681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595a9d-d72d-4192-b667-3d58ea51a98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:53.558911 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5595a9d-d72d-4192-b667-3d58ea51a98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:53.560381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5595a9d-d72d-4192-b667-3d58ea51a98c service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:53.570812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1170/2335] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:13:53.965206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:13:53.966872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:13:53.979091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f1440-64bf-4cef-8556-c333feb811b7 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:13:53.984078 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:13:53.984945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:13:53.985230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:13:53.985505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] PATH_INFO: `/v3/projects/60b9bc7abb3247ebb10f655a103806e2` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:13:53.990365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b9bc7abb3247ebb10f655a103806e2)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:13:53.992606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:13:54.146747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b9bc7abb3247ebb10f655a103806e2', 'request_id': 'req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:54.152255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b9bc7abb3247ebb10f655a103806e2', 'request_id': 'req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:54.158440 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b9bc7abb3247ebb10f655a103806e2', 'request_id': 'req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:54.229595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] The token cache is being invalidate because project 60b9bc7abb3247ebb10f655a103806e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:13:54.230127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:54.230961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-1231ab15-4130-4f0b-bf46-8c8d15bfbc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:13:54.235831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1166/2336] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:13:53 2022] DELETE /identity/v3/projects/60b9bc7abb3247ebb10f655a103806e2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:14:36.745988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b03a3-23e6-41dd-b38f-19173afabfd8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:14:36.746670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b03a3-23e6-41dd-b38f-19173afabfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:14:36.746670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b03a3-23e6-41dd-b38f-19173afabfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:14:36.764335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-707b03a3-23e6-41dd-b38f-19173afabfd8 None None] MFA Rules not processed for user `706ce393383a460b9b5857f74224a1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:14:36.765566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-707b03a3-23e6-41dd-b38f-19173afabfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:14:36.818831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1171/2337] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:14:47.805085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d657a-10fc-4c10-8e5d-a0ece1ad01cb None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:14:47.805707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d657a-10fc-4c10-8e5d-a0ece1ad01cb None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:14:47.805707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d657a-10fc-4c10-8e5d-a0ece1ad01cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:14:47.830530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-039d657a-10fc-4c10-8e5d-a0ece1ad01cb None None] MFA Rules not processed for user `434acf8f6a44484189c95c3504418e20`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:14:47.832382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-039d657a-10fc-4c10-8e5d-a0ece1ad01cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:14:47.904901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1167/2338] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:14:56.008198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:14:56.008796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:14:56.008796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:14:56.029757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] MFA Rules not processed for user `5adf6fccb73242bab32c2fdf0ea23ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:14:56.031006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:14:56.088550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1172/2339] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:14:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:14:59.442459 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7f1d-f09a-4c5f-97b4-368165b460e3 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:14:59.443313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7f1d-f09a-4c5f-97b4-368165b460e3 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:14:59.443313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba7f1d-f09a-4c5f-97b4-368165b460e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:14:59.462258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b0ba7f1d-f09a-4c5f-97b4-368165b460e3 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:14:59.463533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b0ba7f1d-f09a-4c5f-97b4-368165b460e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:14:59.556787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1168/2340] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 26 14:14:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:14:59.729103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:14:59.731196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:14:59.828067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1796b-9aeb-4211-be5f-2ba11b478799 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:14:59.833768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:14:59.834442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:14:59.834730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:14:59.835009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:14:59.843244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:14:59.844945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:14:59.853668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1173/2341] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:14:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:15:09.408523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:09.409080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:09.409287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:09.429364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] MFA Rules not processed for user `797d50f3ba6244f4a62b3abfa24410d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:09.432866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:09.507065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1169/2342] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:10.492064 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:10.493551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:10.567100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7061d-4f42-4747-b8b1-cba565c8fb5d service swift] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:10.572130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:10.573122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:10.573512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:10.575204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] PATH_INFO: `/v3/users/052eaf73262c40e38e14b440fd093738` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:10.577726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=052eaf73262c40e38e14b440fd093738)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:10.579820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:10.847445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052eaf73262c40e38e14b440fd093738'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:10.848112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052eaf73262c40e38e14b440fd093738'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:10.848720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052eaf73262c40e38e14b440fd093738'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.079525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052eaf73262c40e38e14b440fd093738'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.087222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052eaf73262c40e38e14b440fd093738'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.105580 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1174/2343] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:15:10 2022] DELETE /identity/v3/users/052eaf73262c40e38e14b440fd093738 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:15:11.338031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:11.352103 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05a517-3fcd-4464-b647-d4410028a176 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:11.408685 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:11.409535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:11.409818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:11.410140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] PATH_INFO: `/v3/projects/9211b70dd81f45fa8abd2cfaf151e4d6` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:11.411333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9211b70dd81f45fa8abd2cfaf151e4d6)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:11.413250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:11.536513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9211b70dd81f45fa8abd2cfaf151e4d6', 'request_id': 'req-533afa9b-3e7d-4213-b1e6-0e324b198cf9'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.542043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9211b70dd81f45fa8abd2cfaf151e4d6', 'request_id': 'req-533afa9b-3e7d-4213-b1e6-0e324b198cf9'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.548142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9211b70dd81f45fa8abd2cfaf151e4d6', 'request_id': 'req-533afa9b-3e7d-4213-b1e6-0e324b198cf9'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.633336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] The token cache is being invalidate because project 9211b70dd81f45fa8abd2cfaf151e4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:15:11.633688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.639056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.639056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1170/2344] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:15:11 2022] DELETE /identity/v3/projects/9211b70dd81f45fa8abd2cfaf151e4d6 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:11.640265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:11.641716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:11.655541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:11.659091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a6f08-b98c-4078-bfba-76032682bf9d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:11.659215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:11.717012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533afa9b-3e7d-4213-b1e6-0e324b198cf9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:11.722106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:11.722106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:11.722463 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:11.722828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:11.724922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:11.727832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:11.728712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:11.729002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:11.729322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] PATH_INFO: `/v3/users/2ad8cc53244d4b1b872395f11450184b` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:11.730531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad8cc53244d4b1b872395f11450184b)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:11.732623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:11.836943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:11.836943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:11.859444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1171/2345] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:11.867525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:11.867525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:11.872426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339eada-0819-4dd9-921f-b0e13c8130e4 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:11.876386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:11.877609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:11.877887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:11.878228 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:11.881199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:11.895372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:11.896885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:11.908593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1172/2346] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:11.953226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad8cc53244d4b1b872395f11450184b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.954252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad8cc53244d4b1b872395f11450184b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:11.955010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad8cc53244d4b1b872395f11450184b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.022557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad8cc53244d4b1b872395f11450184b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.030868 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-d81f59ed-be7f-4548-b547-e6ceb772b9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad8cc53244d4b1b872395f11450184b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.054515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1175/2347] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:15:11 2022] DELETE /identity/v3/users/2ad8cc53244d4b1b872395f11450184b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:12.293362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:12.295076 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:12.318585 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84894-1f7f-486c-8f21-8d4f6c2f5f20 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:12.391413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:12.392303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:12.393341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:12.393602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] PATH_INFO: `/v3/projects/2ed6d99350394bfebbdd164e5b97882a` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:12.395142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed6d99350394bfebbdd164e5b97882a)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:12.398163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:12.596429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed6d99350394bfebbdd164e5b97882a', 'request_id': 'req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.605183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed6d99350394bfebbdd164e5b97882a', 'request_id': 'req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.613601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed6d99350394bfebbdd164e5b97882a', 'request_id': 'req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.680193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] The token cache is being invalidate because project 2ed6d99350394bfebbdd164e5b97882a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:15:12.680783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.681486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-ca3bd1f2-958d-42db-ba6b-babc3d5a93f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:12.687252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1173/2348] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:15:12 2022] DELETE /identity/v3/projects/2ed6d99350394bfebbdd164e5b97882a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:12.689022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:12.689576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:12.689780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:12.713938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:12.715491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:12.787828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1176/2349] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:12.795847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:12.796128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:12.796408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:12.817500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:12.819277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:12.832063 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1174/2350] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:15:12.836672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:12.862717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581dd16-da5c-46dd-9efc-a4b4dd7595e9 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:12.876455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:12.877022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:12.877348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:12.877655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:12.878491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:15:12.878804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:12.884113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:12.912956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1177/2351] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:15:12.919117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:12.932296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd9d3d-37bd-4efe-b20a-1c08e4e4a6fd None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:12.942949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:12.942949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:12.942949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:12.942949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:12.943352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:12.943352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:13.075446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1175/2352] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:15:12 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:15:13.077178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:13.092316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f6d7d-c6ff-4e8a-bab4-fd51043d66e5 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:13.160885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:13.161723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:13.162149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:13.162541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:13.164005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:13.165861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:13.258683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1178/2353] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:15:13 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:15:13.262797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:13.273140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a726-cc8a-427e-8815-b0e6a8c43ee4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:13.277800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:13.278563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:13.278846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:13.279119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:13.279844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:13.281451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:13.292660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1176/2354] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:15:13.296627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:13.307214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b517be3-bfd9-4ec3-9e9c-95b42248c6bc admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:13.312114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c0774-2678-4cdc-bbcf-7f690b551712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:13.312893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c0774-2678-4cdc-bbcf-7f690b551712 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:13.313208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c0774-2678-4cdc-bbcf-7f690b551712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:13.313515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c0774-2678-4cdc-bbcf-7f690b551712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:13.314352 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c0774-2678-4cdc-bbcf-7f690b551712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:13.316465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c0774-2678-4cdc-bbcf-7f690b551712 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:13.327168 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1179/2355] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:15:13.331135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:13.341197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99d77-a6fb-4c69-acb5-e8d0b2a7c407 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:13.346232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:13.347185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:13.347466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:13.347739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] PATH_INFO: `/v3/projects/488b7e9fc3ac419e8f3acaf1bbfd8838/users/9cd225533a1e48a3a8f03339af74b851/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:13.363922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488b7e9fc3ac419e8f3acaf1bbfd8838, user_id=9cd225533a1e48a3a8f03339af74b851, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:13.367907 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:13.457358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1177/2356] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:15:13 2022] PUT /identity/v3/projects/488b7e9fc3ac419e8f3acaf1bbfd8838/users/9cd225533a1e48a3a8f03339af74b851/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:13.462676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db8e53-c8b5-40a0-aaba-a8a3c22147ae None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:13.462988 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db8e53-c8b5-40a0-aaba-a8a3c22147ae None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:13.463243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db8e53-c8b5-40a0-aaba-a8a3c22147ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:13.507322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-65db8e53-c8b5-40a0-aaba-a8a3c22147ae None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:13.507322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-65db8e53-c8b5-40a0-aaba-a8a3c22147ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:13.577861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1180/2357] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:13.585134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:13.587953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:13.660847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99fc47-afc9-4d53-a09d-e09a8985da81 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:13.664693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:13.665359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:13.665845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:13.666180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:13.679826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:13.681652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:13.693654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1178/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:20.561496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:20.562038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:20.562476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:20.590825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] MFA Rules not processed for user `9cd225533a1e48a3a8f03339af74b851`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:20.592040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:20.658489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1181/2359] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:20.662533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:20.680027 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4811f0-cbe5-4eb6-998a-3b431dcd69c8 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:20.698728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:20.698728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:20.698728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:20.698728 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:20.699114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:20.699114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:20.798549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1179/2360] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:15:20 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:15:20.802914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:20.823946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc7a08-4fb4-47bf-880a-67bb76c4febd None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:20.903411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:20.904114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:20.904445 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:20.905486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:20.906229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:20.911177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:21.001052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1182/2361] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:15:20 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:15:21.005677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:21.016215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad75b95-31e6-4515-973a-436573aabc03 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:21.021486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:21.022251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:21.022541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:21.022817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:21.023536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:21.025132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:21.036234 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1180/2362] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:15:21.040563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:21.050569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d555b9-4f6f-49b0-9863-1ac7101941f8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:21.060223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:21.060223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:21.060223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:21.060223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] PATH_INFO: `/v3/projects/5d96de440e26445094878f0f21a3670a/users/142ed9d411914c72930b49acdfaf68dd/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:21.072751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d96de440e26445094878f0f21a3670a, user_id=142ed9d411914c72930b49acdfaf68dd, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:21.075502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:21.143329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1183/2363] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:15:21 2022] PUT /identity/v3/projects/5d96de440e26445094878f0f21a3670a/users/142ed9d411914c72930b49acdfaf68dd/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:21.147181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:21.156857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095b585-7cc3-4880-ab55-4ed3efcaf3b0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:21.211613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:21.212278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:21.212562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:21.212839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:21.213555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:21.215273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:21.224630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1181/2364] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:15:21.228867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:21.239105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5df33-e1c1-4137-a067-10280520af20 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:21.243740 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:21.244683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:21.244956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:21.245228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] PATH_INFO: `/v3/projects/5d96de440e26445094878f0f21a3670a/users/142ed9d411914c72930b49acdfaf68dd/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:21.247208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d96de440e26445094878f0f21a3670a, user_id=142ed9d411914c72930b49acdfaf68dd, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:21.249856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:21.260710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1184/2365] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:15:21 2022] PUT /identity/v3/projects/5d96de440e26445094878f0f21a3670a/users/142ed9d411914c72930b49acdfaf68dd/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:22.133073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:22.134846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:22.206330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae53f6a-6a23-45e7-9c29-5ed26ed65f9c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:22.262705 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:22.263385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:22.263738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:22.264021 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:22.265901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:22.324932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:22.326407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddbb40-4d37-42a1-b479-83fdee51951b service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:22.335128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1182/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:15:26.796562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:26.870786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79b4a-324c-48cd-a6b5-4ca7ca441e8b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:26.874504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:26.875163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:26.875449 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:26.876936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:26.877618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:26.888448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:26.889888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:26.898618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1185/2367] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:27.313300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:27.313839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:27.314095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:27.340244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] MFA Rules not processed for user `142ed9d411914c72930b49acdfaf68dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:27.342332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:27.418604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1183/2368] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:15:27.430123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:27.431653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:27.520968 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9caea7-2274-4afa-bbe0-5e3da6990dab service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:27.526867 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637924b-c7b2-4be7-8472-de56b141ab1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:27.527516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637924b-c7b2-4be7-8472-de56b141ab1a service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:27.527827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637924b-c7b2-4be7-8472-de56b141ab1a service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:27.528105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637924b-c7b2-4be7-8472-de56b141ab1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:27.589879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637924b-c7b2-4be7-8472-de56b141ab1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:27.591569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637924b-c7b2-4be7-8472-de56b141ab1a service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:27.600901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1186/2369] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:30.765325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:30.786353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f553e4-95dc-47ee-bd27-10cd966c968e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:30.812341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:30.813356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:30.813837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:30.814350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:30.816613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:30.841345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:30.843321 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:30.856365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1184/2370] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:15:49.625919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:49.626462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:49.626561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:49.644634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] MFA Rules not processed for user `9cd225533a1e48a3a8f03339af74b851`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:49.646431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:49.653326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1187/2371] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:49.962710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:49.971643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915bee6-623f-4cac-8141-8211d3f83e68 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:49.976108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:49.976785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:49.977065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:49.977336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:49.979083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:49.988391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:49.989824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:49.997578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1185/2372] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:50.731551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:50.733397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:50.804422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc6e41-16fb-490d-8fa8-9115e1aa2a6a None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:50.816756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952f39b205c74255a2776e7fec3b8643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:50.817435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:50.817724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:50.818033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:50.819952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:50.833097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:50.834736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:50.845901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1188/2373] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:52.843153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:52.844141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:52.855068 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0133b-29ba-49a0-a64f-b976a49260d8 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:52.858737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:52.859364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:52.859641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:52.860196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:52.861926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:52.925410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:52.926919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:52.936836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1186/2374] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:56.994287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:56.995743 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:57.009383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e6189-5296-42e0-9887-91cc5f80fdab service placement] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:57.013843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:57.014736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.015020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.015295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] PATH_INFO: `/v3/users/706ce393383a460b9b5857f74224a1fa` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.016468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=706ce393383a460b9b5857f74224a1fa)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:57.018406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:57.131585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706ce393383a460b9b5857f74224a1fa'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.132228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706ce393383a460b9b5857f74224a1fa'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.132829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706ce393383a460b9b5857f74224a1fa'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.175869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706ce393383a460b9b5857f74224a1fa'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.183113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-29e6d153-86cf-47cf-8244-56c6ee182544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706ce393383a460b9b5857f74224a1fa'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.199374 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1189/2375] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:15:56 2022] DELETE /identity/v3/users/706ce393383a460b9b5857f74224a1fa => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:57.449099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:57.450778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5032bd-7a19-4a8a-9067-3910f931022f service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:57.507491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:57.508347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.508628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.508901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] PATH_INFO: `/v3/projects/afa3fcb59a274c22bcf1ebcf44211943` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.510105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa3fcb59a274c22bcf1ebcf44211943)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:57.512261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:57.624448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa3fcb59a274c22bcf1ebcf44211943', 'request_id': 'req-444e11b4-ffee-42bd-809d-3eb71ad16334'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.629757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa3fcb59a274c22bcf1ebcf44211943', 'request_id': 'req-444e11b4-ffee-42bd-809d-3eb71ad16334'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.635923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa3fcb59a274c22bcf1ebcf44211943', 'request_id': 'req-444e11b4-ffee-42bd-809d-3eb71ad16334'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.713197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] The token cache is being invalidate because project afa3fcb59a274c22bcf1ebcf44211943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:15:57.713407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.714054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:57.715593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1187/2376] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:15:57 2022] DELETE /identity/v3/projects/afa3fcb59a274c22bcf1ebcf44211943 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:57.720688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc146508-9c1d-497e-b7f7-23e971f46ca3 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.720980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc146508-9c1d-497e-b7f7-23e971f46ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.721258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc146508-9c1d-497e-b7f7-23e971f46ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.734369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:57.735827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:57.740581 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-bc146508-9c1d-497e-b7f7-23e971f46ca3 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:57.741775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-bc146508-9c1d-497e-b7f7-23e971f46ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:57.813741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e11b4-ffee-42bd-809d-3eb71ad16334 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:57.819221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1190/2377] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:57.820113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:57.820770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.821075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.821381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.823238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:57.826834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.827131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.827535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.848194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:57.849407 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:57.861378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1191/2378] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:15:57.862629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:57.872880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86b26-0978-4b1b-9c21-80e32b23362b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:57.879530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:57.879530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.879530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.880605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.880605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:15:57.880777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:57.882275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:57.883591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:57.885264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:57.895774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1188/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:15:57.896223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1192/2380] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:15:57.902960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:57.914261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b635b7-78c0-4dc5-833c-7483d60cce07 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:57.920389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:57.921053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:57.921363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:57.921643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:57.922367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:57.930178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:58.014109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1189/2381] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:15:57 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:15:58.018904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:58.035907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfc0d-72b3-47cf-b07e-8a1396e0ff44 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:58.102616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:58.103285 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:58.103576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:58.103852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:58.104539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:58.106487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:58.176241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1193/2382] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:15:58 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:15:58.180509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:58.190888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f01dd-8600-49fc-b62b-755b3fa237f7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:58.195636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:58.196294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:58.196577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:58.196851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:58.197737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:58.199380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:58.210516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1190/2383] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:15:58.217617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:58.225198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8d22-5802-49de-823f-49b1a2052c23 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:58.229846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c491d-863d-4b7e-8f3f-e4593663173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:58.230530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c491d-863d-4b7e-8f3f-e4593663173b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:58.230837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c491d-863d-4b7e-8f3f-e4593663173b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:58.231097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c491d-863d-4b7e-8f3f-e4593663173b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:58.231965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c491d-863d-4b7e-8f3f-e4593663173b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:58.233562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c491d-863d-4b7e-8f3f-e4593663173b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:58.244236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1194/2384] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:15:58.252533 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:58.262914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669842b7-fd63-472a-b4c1-7b1f93a4137f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:58.267449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:58.268323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:58.268604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:58.268882 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] PATH_INFO: `/v3/projects/ceae37df7abe4226ab88abbc1d289a5c/users/7bee532aeccf4bfe84c0e984651524dc/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:58.283379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceae37df7abe4226ab88abbc1d289a5c, user_id=7bee532aeccf4bfe84c0e984651524dc, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:58.289658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:58.364303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1191/2385] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:15:58 2022] PUT /identity/v3/projects/ceae37df7abe4226ab88abbc1d289a5c/users/7bee532aeccf4bfe84c0e984651524dc/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:15:58.369523 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:58.369864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:58.370245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:58.387524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:15:58.388710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:58.449893 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1195/2386] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:15:58.460556 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:58.462305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:58.517934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e70d5-248c-4c5f-851a-3550d30cc050 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:58.522370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:58.523017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:58.523317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:58.523578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:58.533548 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:58.535229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:58.545600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1192/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:15:59.651862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:15:59.653399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:15:59.666654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f55bf-59bf-4595-9821-755f7e235d6f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:15:59.676396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:15:59.676396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:15:59.676396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:15:59.676396 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] PATH_INFO: `/v3/users/434acf8f6a44484189c95c3504418e20` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:15:59.676748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434acf8f6a44484189c95c3504418e20)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:15:59.676877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:15:59.863865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434acf8f6a44484189c95c3504418e20'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:59.864520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434acf8f6a44484189c95c3504418e20'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:59.865124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434acf8f6a44484189c95c3504418e20'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:59.924897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434acf8f6a44484189c95c3504418e20'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:59.932225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01736099-6797-48fb-9c5a-0adab53ed603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434acf8f6a44484189c95c3504418e20'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:15:59.958030 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1196/2388] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:15:59 2022] DELETE /identity/v3/users/434acf8f6a44484189c95c3504418e20 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:00.241887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:00.256765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ede6d-6084-4bb3-9a06-b5b6a9973f51 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:00.325752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:00.326657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:00.326940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:00.327222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] PATH_INFO: `/v3/projects/044c341dbfb24ed2812bc91e85e6b06a` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:00.329227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=044c341dbfb24ed2812bc91e85e6b06a)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:00.331209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:00.468971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044c341dbfb24ed2812bc91e85e6b06a', 'request_id': 'req-c6582b4a-eb58-4399-ba47-95e96e545fbf'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:00.477346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044c341dbfb24ed2812bc91e85e6b06a', 'request_id': 'req-c6582b4a-eb58-4399-ba47-95e96e545fbf'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:00.484813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044c341dbfb24ed2812bc91e85e6b06a', 'request_id': 'req-c6582b4a-eb58-4399-ba47-95e96e545fbf'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:00.553910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] The token cache is being invalidate because project 044c341dbfb24ed2812bc91e85e6b06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:16:00.556972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:00.556972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c6582b4a-eb58-4399-ba47-95e96e545fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:00.556972 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1193/2389] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:16:00 2022] DELETE /identity/v3/projects/044c341dbfb24ed2812bc91e85e6b06a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:00.562053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:00.562346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:00.562892 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:00.584658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:00.586245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:00.647453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1197/2390] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:00.655149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:00.655559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:00.655964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:00.676028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:00.677367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:00.686401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1194/2391] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:00.690693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:00.702698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d534f4f-2d38-4fae-80bb-dff7f769bc7f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:00.708842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:00.709741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:00.710323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:00.710848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:00.711753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:16:00.712219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:00.714254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:00.731452 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1198/2392] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:16:00.732914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:00.742877 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b78a36-176f-43dc-8d92-00d19da53582 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:00.749516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:00.750407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:00.750847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:00.751308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:00.752186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:00.755614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:00.876075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1195/2393] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:16:00 2022] POST /identity/v3/projects => generated 399 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:16:00.880545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:00.892717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46637feb-9b45-4413-a947-42932790d3b5 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:00.992334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:00.993072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:00.993365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:00.993641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:00.994389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:00.996351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:01.116506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1199/2394] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:16:00 2022] POST /identity/v3/users => generated 300 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:01.117688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:01.127793 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336abf81-ad21-44e2-8998-671821593983 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:01.132499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:01.133196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:01.133481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:01.133761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:01.134678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:01.136297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:01.147077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1196/2395] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:01.151042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:01.162386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe58c7-d07d-4830-9a1f-7b5c5a8156d5 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:01.167158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b784-9a5f-44c0-aa8c-f84d7b4b885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:01.167821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b784-9a5f-44c0-aa8c-f84d7b4b885e admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:01.168102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b784-9a5f-44c0-aa8c-f84d7b4b885e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:01.168399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b784-9a5f-44c0-aa8c-f84d7b4b885e admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:01.169132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b784-9a5f-44c0-aa8c-f84d7b4b885e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:01.170766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b784-9a5f-44c0-aa8c-f84d7b4b885e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:01.184877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1200/2396] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:01.186307 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:01.197001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd208c-3a53-4fec-91bd-ba3ce67cf6d0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:01.201599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:01.202554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:01.202834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:01.203104 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] PATH_INFO: `/v3/projects/d2fbf662c6a4417098720be8d7774380/users/9022a88f45804a7ca2900adf2ee0ed3d/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:01.220467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fbf662c6a4417098720be8d7774380, user_id=9022a88f45804a7ca2900adf2ee0ed3d, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:01.223958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:01.279830 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1197/2397] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:01 2022] PUT /identity/v3/projects/d2fbf662c6a4417098720be8d7774380/users/9022a88f45804a7ca2900adf2ee0ed3d/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:01.290944 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d46cd-2e85-4c69-8dd2-37da330974e2 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:01.291681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d46cd-2e85-4c69-8dd2-37da330974e2 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:01.292027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d46cd-2e85-4c69-8dd2-37da330974e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:01.319756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-420d46cd-2e85-4c69-8dd2-37da330974e2 None None] MFA Rules not processed for user `9022a88f45804a7ca2900adf2ee0ed3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:01.320990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-420d46cd-2e85-4c69-8dd2-37da330974e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:01.387763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1201/2398] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:16:01.400502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:01.402236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:01.467770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4bbcf-2f95-435d-9786-fddd80f5f4e9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:01.472071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:01.473184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:01.473620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:01.474245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:01.483513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:01.485865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:01.500206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1198/2399] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:04.369414 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:04.369959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:04.369959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:04.397489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] MFA Rules not processed for user `7bee532aeccf4bfe84c0e984651524dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:04.398738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:04.473801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1202/2400] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:04.484957 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:04.486434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:04.568694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c0e5a-2034-4da3-9b8a-c7a0d374ee6b service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:04.575191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e934cd-41c3-46e6-b2c1-c1adaa83af4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:04.575956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e934cd-41c3-46e6-b2c1-c1adaa83af4a service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:04.576411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e934cd-41c3-46e6-b2c1-c1adaa83af4a service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:04.576716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e934cd-41c3-46e6-b2c1-c1adaa83af4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:04.585428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e934cd-41c3-46e6-b2c1-c1adaa83af4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:04.587246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e934cd-41c3-46e6-b2c1-c1adaa83af4a service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:04.599910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1199/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:05.220715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:05.221027 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:05.238741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a214a6-b24a-4bc2-a190-b1135aed3526 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:05.244394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:05.245046 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:05.245357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:05.245634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:05.247845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:05.261750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:05.263377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:05.274232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1203/2402] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:07.184333 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:07.184812 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:07.184910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:07.203609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] MFA Rules not processed for user `7bee532aeccf4bfe84c0e984651524dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:07.204999 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:07.213445 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1200/2403] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:09.297497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:09.310599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:09.367798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b37b12-3145-48d6-a4af-03469ad4efba service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:09.371459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:09.372104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:09.372391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:09.372671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:09.374589 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:09.439475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:09.440935 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b743b68-25db-4cdc-9dd1-817f33e1a481 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:09.451050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1204/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:10.491264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:10.563903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454956f4-35b5-45d7-8282-dd4602553a94 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:10.568411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:10.569345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:10.569620 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:10.569898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] PATH_INFO: `/v3/users/9022a88f45804a7ca2900adf2ee0ed3d` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:10.571128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=9022a88f45804a7ca2900adf2ee0ed3d)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:10.573045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:10.764118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9022a88f45804a7ca2900adf2ee0ed3d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:10.777933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9022a88f45804a7ca2900adf2ee0ed3d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:10.778721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9022a88f45804a7ca2900adf2ee0ed3d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:10.786486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9022a88f45804a7ca2900adf2ee0ed3d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:10.787233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9022a88f45804a7ca2900adf2ee0ed3d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:11.039111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1201/2405] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:16:10 2022] DELETE /identity/v3/users/9022a88f45804a7ca2900adf2ee0ed3d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:11.043618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:11.044332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:11.044332 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:11.061466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:11.062768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:11.127707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1205/2406] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:16:11.138099 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:11.139514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:11.200622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3d9e-a080-4b9d-8a58-d5c149a49dae admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:11.204439 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ceaa94-c0ad-42da-aa04-d012c3be3e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:11.205094 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceaa94-c0ad-42da-aa04-d012c3be3e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:11.205380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceaa94-c0ad-42da-aa04-d012c3be3e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:11.205656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceaa94-c0ad-42da-aa04-d012c3be3e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:11.215850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ceaa94-c0ad-42da-aa04-d012c3be3e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:11.217267 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ceaa94-c0ad-42da-aa04-d012c3be3e54 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:11.228467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1202/2407] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:12.035629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.037876 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:12.062566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b9994-4f14-4da2-b899-3db125950678 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.074602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.077117 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.077508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.081620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] PATH_INFO: `/v3/projects/d2fbf662c6a4417098720be8d7774380` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.081620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fbf662c6a4417098720be8d7774380)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.087493 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:12.251156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fbf662c6a4417098720be8d7774380', 'request_id': 'req-01ed3e92-67b1-4286-a730-b71dc4ada971'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:12.302361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fbf662c6a4417098720be8d7774380', 'request_id': 'req-01ed3e92-67b1-4286-a730-b71dc4ada971'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:12.308480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fbf662c6a4417098720be8d7774380', 'request_id': 'req-01ed3e92-67b1-4286-a730-b71dc4ada971'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:12.321335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] The token cache is being invalidate because project d2fbf662c6a4417098720be8d7774380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:16:12.321630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:12.322481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-01ed3e92-67b1-4286-a730-b71dc4ada971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:12.324964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1206/2408] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:16:12 2022] DELETE /identity/v3/projects/d2fbf662c6a4417098720be8d7774380 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:12.329167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.329804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.329916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.347914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:12.349456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:12.407358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1203/2409] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:16:12.416338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.416629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.416924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.436015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:12.437223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:12.452518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1207/2410] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:12.464407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.474948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d3c0-5301-4128-b80c-92a4ed369c47 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.479756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.480494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.480848 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.481193 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.482010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:16:12.482393 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.484033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:12.499509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1204/2411] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:16:12.501092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.511102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb45507-bff0-4a14-9955-e974947db43f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.516095 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.516780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.517196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.517478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.518216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.520161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:12.592176 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1208/2412] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:16:12 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:12.593257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.603718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dacc40-ceec-4e1f-b5ef-51ee7e40daf2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.665685 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.666514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.666801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.667135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.667854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.669797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:12.805798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1205/2413] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:16:12 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:16:12.810229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.821042 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0b532-e91b-45c2-8ac8-9c9f312e4a46 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.826178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.827121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.827487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.829388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.829388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.831224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:12.849187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1209/2414] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:12.850826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.863570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0311f48-b191-4d23-bc08-d64f3aed3f3a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.869037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9de045-ce0d-4df0-a555-efa59b832352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.869713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9de045-ce0d-4df0-a555-efa59b832352 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.870089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9de045-ce0d-4df0-a555-efa59b832352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.870290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9de045-ce0d-4df0-a555-efa59b832352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.871261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9de045-ce0d-4df0-a555-efa59b832352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.872617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9de045-ce0d-4df0-a555-efa59b832352 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:12.886928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1206/2415] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:12.888116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:12.898748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d220b9-272e-4070-aef2-b39800f017ab admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:12.906380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:12.907645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:12.908091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:12.908562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] PATH_INFO: `/v3/projects/51ea97fcafba4e8fbdd5c7004c94eafe/users/688c6bd837bf4f1cbde64e64651ff745/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:12.926540 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ea97fcafba4e8fbdd5c7004c94eafe, user_id=688c6bd837bf4f1cbde64e64651ff745, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:12.929682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:13.001497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1210/2416] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:12 2022] PUT /identity/v3/projects/51ea97fcafba4e8fbdd5c7004c94eafe/users/688c6bd837bf4f1cbde64e64651ff745/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:13.003134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab625-f596-46e4-8837-1a127b12b713 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:13.003807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab625-f596-46e4-8837-1a127b12b713 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:13.003807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab625-f596-46e4-8837-1a127b12b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:13.023150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-53eab625-f596-46e4-8837-1a127b12b713 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:13.024311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-53eab625-f596-46e4-8837-1a127b12b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:13.156952 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:13.158926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:13.166091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1207/2417] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:13.220195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced28b3-8dab-4939-bf22-c13010df226d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:13.224799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:13.225473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:13.225760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:13.226102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:13.236296 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:13.237804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:13.248696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1211/2418] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:18.836443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:18.843837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:18.843837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:18.876437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] MFA Rules not processed for user `688c6bd837bf4f1cbde64e64651ff745`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:18.877636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:18.960407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1208/2419] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:18.964654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:18.976327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e434f5-92dd-431a-ba47-42cb77e0aaac service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:18.983146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:18.983890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:18.984325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:18.984612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:18.985606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:18.988869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:19.111834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1212/2420] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:16:18 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:19.113652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:19.130062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f4639-f383-4fe5-91a6-576745e755d8 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:19.230506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:19.231318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:19.231679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:19.232559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:19.233305 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:19.235297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:19.320665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1209/2421] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:16:19 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:19.325041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:19.337003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a9603-87a9-4ab4-95ef-9371406307ea admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:19.343087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:19.343997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:19.344433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:19.345020 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:19.345939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:19.348229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:19.360601 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1213/2422] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:19.364925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:19.381327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347df13-c0ee-417a-a661-1c4a1a67286d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:19.391403 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:19.394677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:19.395366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:19.396391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] PATH_INFO: `/v3/projects/05d000457ca74d21815ddae0a2d3f2bc/users/c4b16de5dea24a5798f0b81cbf3b85ec/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:19.421407 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d000457ca74d21815ddae0a2d3f2bc, user_id=c4b16de5dea24a5798f0b81cbf3b85ec, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:19.424651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:19.510250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1210/2423] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:19 2022] PUT /identity/v3/projects/05d000457ca74d21815ddae0a2d3f2bc/users/c4b16de5dea24a5798f0b81cbf3b85ec/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:19.514398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:19.527415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534e70-2a53-4fdc-98b3-72ed4239007d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:19.614588 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18c261-f4a1-4b7f-b6b5-62ef62b25866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:19.615678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18c261-f4a1-4b7f-b6b5-62ef62b25866 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:19.616262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18c261-f4a1-4b7f-b6b5-62ef62b25866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:19.616714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18c261-f4a1-4b7f-b6b5-62ef62b25866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:19.617872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18c261-f4a1-4b7f-b6b5-62ef62b25866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:19.619855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18c261-f4a1-4b7f-b6b5-62ef62b25866 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:19.634196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1214/2424] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:19.641332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:19.659028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339121f0-f42b-4f02-9595-8c452e5e092b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:19.664368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:19.665282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:19.665573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:19.665852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] PATH_INFO: `/v3/projects/05d000457ca74d21815ddae0a2d3f2bc/users/c4b16de5dea24a5798f0b81cbf3b85ec/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:19.668320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d000457ca74d21815ddae0a2d3f2bc, user_id=c4b16de5dea24a5798f0b81cbf3b85ec, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:19.671277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:19.690074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1211/2425] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:19 2022] PUT /identity/v3/projects/05d000457ca74d21815ddae0a2d3f2bc/users/c4b16de5dea24a5798f0b81cbf3b85ec/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:25.745388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce90da6-2e37-4ce6-906e-d969f3675299 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:25.745841 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce90da6-2e37-4ce6-906e-d969f3675299 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:25.745937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce90da6-2e37-4ce6-906e-d969f3675299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:25.779011 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7ce90da6-2e37-4ce6-906e-d969f3675299 None None] MFA Rules not processed for user `c4b16de5dea24a5798f0b81cbf3b85ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:25.780548 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7ce90da6-2e37-4ce6-906e-d969f3675299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:25.857366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1215/2426] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:25.868682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:25.872861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:25.966611 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71823bc3-9ada-43dd-8b1a-afbd2c536b61 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:25.973896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7059f3f-1914-4d1c-8ce2-d01213eb170b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:25.974798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7059f3f-1914-4d1c-8ce2-d01213eb170b service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:25.975164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7059f3f-1914-4d1c-8ce2-d01213eb170b service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:25.975673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7059f3f-1914-4d1c-8ce2-d01213eb170b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:26.060131 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7059f3f-1914-4d1c-8ce2-d01213eb170b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:26.062828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7059f3f-1914-4d1c-8ce2-d01213eb170b service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:26.086543 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1212/2427] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:29.073261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:29.074282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:29.081831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:29.104277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] MFA Rules not processed for user `688c6bd837bf4f1cbde64e64651ff745`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:29.106273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:29.115442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1216/2428] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:38.086285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:38.086686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:38.087278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:38.103945 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] MFA Rules not processed for user `797d50f3ba6244f4a62b3abfa24410d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:38.105204 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:38.160258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1213/2429] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:38.469416 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:38.524649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c43daf-25d9-40cf-9229-a23795a5ea2b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:38.528424 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:38.529091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:38.529379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:38.529661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:38.531698 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:38.542738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:38.544178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:38.552178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1217/2430] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:39.464697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:39.466185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:39.478573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a209da-ffb6-4d9f-bf21-6dfc25ce2932 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:39.482109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:39.482778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:39.484288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:39.484566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:39.486424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:39.551162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:39.552613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:39.562582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1214/2431] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:44.388001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:44.389696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:44.404940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4b45b-36d4-4965-8f1e-b5e7cef2ef24 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:44.410272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:44.411142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:44.411431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:44.411713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] PATH_INFO: `/v3/users/5adf6fccb73242bab32c2fdf0ea23ff3` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:44.414225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5adf6fccb73242bab32c2fdf0ea23ff3)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:44.415125 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:44.594508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5adf6fccb73242bab32c2fdf0ea23ff3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:44.597350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5adf6fccb73242bab32c2fdf0ea23ff3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:44.597350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5adf6fccb73242bab32c2fdf0ea23ff3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:44.666646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5adf6fccb73242bab32c2fdf0ea23ff3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:44.673831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0153b8fe-b7d7-4631-82bd-b139519f8635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5adf6fccb73242bab32c2fdf0ea23ff3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:44.690609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1218/2432] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:16:44 2022] DELETE /identity/v3/users/5adf6fccb73242bab32c2fdf0ea23ff3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:44.942238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:44.951787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568667f0-1292-42e3-8ef1-4015239317ee service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.019012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.019874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.020148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.020412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] PATH_INFO: `/v3/projects/3f38bbf345384bdb9ed001c0965a3462` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.021612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f38bbf345384bdb9ed001c0965a3462)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.023590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.135595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f38bbf345384bdb9ed001c0965a3462', 'request_id': 'req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:45.140854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f38bbf345384bdb9ed001c0965a3462', 'request_id': 'req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:45.146983 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f38bbf345384bdb9ed001c0965a3462', 'request_id': 'req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:45.231399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] The token cache is being invalidate because project 3f38bbf345384bdb9ed001c0965a3462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:16:45.231616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:45.232236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-7721b3c3-4a7a-4f5a-93a5-605afb9373a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:45.233804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1215/2433] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:16:44 2022] DELETE /identity/v3/projects/3f38bbf345384bdb9ed001c0965a3462 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:45.239395 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.239688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.239972 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.257955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:45.259196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:45.317047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1219/2434] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:45.324733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.331982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.331982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.343977 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:45.345178 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:45.353777 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1216/2435] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:45.357908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.367526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efebef-1699-4c37-a427-f1cd15d0c2ca None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.372197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.372837 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.373123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.373398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.374188 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:16:45.374497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.376113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.387501 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1220/2436] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:16:45.391537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.401146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e2283-5679-48dd-a1ee-88826ae3be0e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.405773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.406441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.406724 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.406998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.407687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.410171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.479862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1217/2437] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:16:45 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:45.485642 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.494133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040290c-6667-44db-a025-e54644712cfa admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.547809 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.548465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.548756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.549031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.549709 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.551649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.666730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1221/2438] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:16:45 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:45.670754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.681028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef733d1d-e519-46a5-b5ec-6baf93b0d578 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.685598 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.686292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.686687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.686968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.687681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.689291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.699587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1218/2439] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:45.703703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.714320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b916193-2af8-4c2c-8718-66bdbba65726 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.719146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07b9d7-1307-4383-a7cc-7cbcc82625b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.719802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b9d7-1307-4383-a7cc-7cbcc82625b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.720097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b9d7-1307-4383-a7cc-7cbcc82625b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.720381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07b9d7-1307-4383-a7cc-7cbcc82625b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.721121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07b9d7-1307-4383-a7cc-7cbcc82625b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.722769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07b9d7-1307-4383-a7cc-7cbcc82625b1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.732584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1222/2440] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:45.736580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.746248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa588e5-17bf-48fd-8577-9930e76f4a55 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:45.750769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:45.751651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.751933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.752209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] PATH_INFO: `/v3/projects/eadb79dd46ed4dc6aad22adf06a5f80d/users/63dbb8ebbf1c42bf8801324f16a8206d/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.766721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb79dd46ed4dc6aad22adf06a5f80d, user_id=63dbb8ebbf1c42bf8801324f16a8206d, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:45.769464 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:45.848940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1219/2441] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:45 2022] PUT /identity/v3/projects/eadb79dd46ed4dc6aad22adf06a5f80d/users/63dbb8ebbf1c42bf8801324f16a8206d/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:16:45.865392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:45.865769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:45.866122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:45.893887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] MFA Rules not processed for user `63dbb8ebbf1c42bf8801324f16a8206d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:45.895180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:45.959921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1223/2442] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:45.970786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:45.972587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:46.044607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fab73-5358-4b70-968a-3cd97c67e0c4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:46.050789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:46.051435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:46.051718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:46.051989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:46.060105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:46.061820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:46.071564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1220/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:49.044592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:49.046084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:49.072418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13cede-bca7-4bb4-8ab4-9152c74c03be None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:49.078123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:49.078775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:49.079062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:49.079338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:49.081091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:49.144810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:49.146457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fa293-5962-4da2-83a1-953352a19e01 service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:49.155932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1224/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:54.317467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:54.381577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4693b7-5f9a-4685-a1ce-6b1821e992b2 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:54.386165 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:54.390982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:54.390982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:54.390982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] PATH_INFO: `/v3/users/63dbb8ebbf1c42bf8801324f16a8206d` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:54.390982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dbb8ebbf1c42bf8801324f16a8206d)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:54.390982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:54.599246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dbb8ebbf1c42bf8801324f16a8206d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:54.611111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dbb8ebbf1c42bf8801324f16a8206d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:54.612345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dbb8ebbf1c42bf8801324f16a8206d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:54.618863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dbb8ebbf1c42bf8801324f16a8206d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:54.619482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dbb8ebbf1c42bf8801324f16a8206d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:54.706484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1221/2445] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:16:54 2022] DELETE /identity/v3/users/63dbb8ebbf1c42bf8801324f16a8206d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:54.711079 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:54.711553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:54.711729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:54.731235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:54.732436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:54.789712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1225/2446] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:54.799959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:54.801368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:54.856735 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb9636-811a-405b-8d43-06358e7df8a9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:54.860381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5caa85b-43f4-4d26-98d2-1bfe8a0f3b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:54.861038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa85b-43f4-4d26-98d2-1bfe8a0f3b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:54.861299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa85b-43f4-4d26-98d2-1bfe8a0f3b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:54.862185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5caa85b-43f4-4d26-98d2-1bfe8a0f3b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:54.871654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caa85b-43f4-4d26-98d2-1bfe8a0f3b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:54.873148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5caa85b-43f4-4d26-98d2-1bfe8a0f3b4f service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:54.883394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1222/2447] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:55.416723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:55.418232 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:55.435039 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe88ecd-6816-4c5b-90ad-32b604c2fafc None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:55.448177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:55.449059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:55.449683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:55.449683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] PATH_INFO: `/v3/projects/eadb79dd46ed4dc6aad22adf06a5f80d` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:55.450957 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadb79dd46ed4dc6aad22adf06a5f80d)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:55.453083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:55.588309 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadb79dd46ed4dc6aad22adf06a5f80d', 'request_id': 'req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:55.655121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadb79dd46ed4dc6aad22adf06a5f80d', 'request_id': 'req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:55.662305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadb79dd46ed4dc6aad22adf06a5f80d', 'request_id': 'req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:55.674741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] The token cache is being invalidate because project eadb79dd46ed4dc6aad22adf06a5f80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:16:55.675255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:55.676097 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5a91c590-7cc3-46db-a2c1-36b9266e6d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:16:55.677657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1226/2448] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:16:55 2022] DELETE /identity/v3/projects/eadb79dd46ed4dc6aad22adf06a5f80d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:55.682750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:55.683643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:55.684146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:55.702699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:55.706010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:55.773280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1223/2449] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:55.780672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:55.781213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:55.781510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:55.802947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:55.804186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:55.812429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1227/2450] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:16:55.816722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:55.826458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4effe-a798-43d8-825a-82d51a90b096 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:55.832324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:55.832998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:55.833277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:55.833722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:55.834545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:16:55.834853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:55.836616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:55.850474 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1224/2451] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:16:55.856413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:55.868107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f6624-acac-4005-ad92-be6b2da3f139 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:55.874112 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:55.874984 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:55.875549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:55.875980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:55.877132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:55.879121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:55.975299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1228/2452] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:16:55 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:55.976114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:55.987057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41c8e9-4c5b-43ed-9c15-2e1a00fbcbec admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.048547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.049323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.049671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.050046 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.050961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.053014 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.155737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1225/2453] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:16:55 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:16:56.156991 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.168130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33039722-2203-490d-936d-c292ccd5ff0e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.172778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.173439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.173917 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.174347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.175096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.176697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.187381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1229/2454] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:56.191936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.202010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dde0-167b-4d98-b2d7-67a941bde035 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.207722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c590d3-cf70-4b51-87be-16f85b706fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.208390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c590d3-cf70-4b51-87be-16f85b706fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.208675 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c590d3-cf70-4b51-87be-16f85b706fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.209140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c590d3-cf70-4b51-87be-16f85b706fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.209835 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c590d3-cf70-4b51-87be-16f85b706fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.211552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c590d3-cf70-4b51-87be-16f85b706fb9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.221939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1226/2455] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:56.226294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.236995 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682012ee-b6df-481d-bb6d-26af7dcd623b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.242840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.244091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.244459 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.248568 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] PATH_INFO: `/v3/projects/d7de67493e8c41fdb4fbb34ef531130c/users/0a5033847ac04e4b9b45cf3fe14a119e/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.260826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7de67493e8c41fdb4fbb34ef531130c, user_id=0a5033847ac04e4b9b45cf3fe14a119e, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.263677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.329889 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1230/2456] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:56 2022] PUT /identity/v3/projects/d7de67493e8c41fdb4fbb34ef531130c/users/0a5033847ac04e4b9b45cf3fe14a119e/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:56.340406 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.340700 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.340981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.370070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] MFA Rules not processed for user `0a5033847ac04e4b9b45cf3fe14a119e`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:56.371282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:56.443736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1227/2457] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:16:56.448548 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.509810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bfa6ee-1d56-4f97-b436-769f84724630 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.515209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.515898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.516187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.516865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.517645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.519171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.601824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1231/2458] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:16:56 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:56.605939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.617129 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58fff2-1013-445a-b4c4-13d185d2261c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.678336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.679153 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.679436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.679713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.680431 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.682702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.798198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1228/2459] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:16:56 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:16:56.802182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.812526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33265447-4c2d-4be9-89fd-7d7c4abf5f78 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.817421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.818153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.818442 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.818724 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.819461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.821066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.832250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1232/2460] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:56.836023 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:56.846919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef320fe-c6fd-4f2f-87e3-d7d22b9968b0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:56.851855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:56.853399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:56.853399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:56.853399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] PATH_INFO: `/v3/projects/c2cd40429ac6450e8953cd8473cbbd20/users/269b796f42eb4cd388862edc372b660f/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:56.867892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cd40429ac6450e8953cd8473cbbd20, user_id=269b796f42eb4cd388862edc372b660f, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:56.870646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:56.986332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1229/2461] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:56 2022] PUT /identity/v3/projects/c2cd40429ac6450e8953cd8473cbbd20/users/269b796f42eb4cd388862edc372b660f/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:16:56.990237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:57.000074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2270-ed10-4775-99d2-b1ae49206fad admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:57.053710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f14d9a-147f-4d2c-a003-547c5cb3415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:57.054327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14d9a-147f-4d2c-a003-547c5cb3415e admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:57.054617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14d9a-147f-4d2c-a003-547c5cb3415e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:57.054898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f14d9a-147f-4d2c-a003-547c5cb3415e admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:57.055620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f14d9a-147f-4d2c-a003-547c5cb3415e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:57.057210 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f14d9a-147f-4d2c-a003-547c5cb3415e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:57.067509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1233/2462] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:16:57.071539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:57.082203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53431fff-28ee-4dd7-b028-e2a21323ea32 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:57.086745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:57.087615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:57.087926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:57.088201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] PATH_INFO: `/v3/projects/c2cd40429ac6450e8953cd8473cbbd20/users/269b796f42eb4cd388862edc372b660f/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:57.090192 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2cd40429ac6450e8953cd8473cbbd20, user_id=269b796f42eb4cd388862edc372b660f, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:57.092827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:57.102649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1230/2463] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:16:57 2022] PUT /identity/v3/projects/c2cd40429ac6450e8953cd8473cbbd20/users/269b796f42eb4cd388862edc372b660f/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:16:57.113845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:57.114187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:57.114468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:57.140558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] MFA Rules not processed for user `269b796f42eb4cd388862edc372b660f`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:16:57.141772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:57.207007 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1234/2464] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:16:57.217954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:57.219624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:16:57.275716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3c6f8-f82f-40e4-9043-90bca62b61c2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:57.279368 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:57.280004 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:57.280289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:57.280566 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:57.289574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:57.291032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:57.301255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1231/2465] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:16:57.479419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:16:57.489593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df810-0dc9-4e82-b428-1979594a9ab8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:16:57.493135 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb043edd-0b85-42a0-8f0f-fc790bea08d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:16:57.493765 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043edd-0b85-42a0-8f0f-fc790bea08d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:16:57.494083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043edd-0b85-42a0-8f0f-fc790bea08d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:16:57.494360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb043edd-0b85-42a0-8f0f-fc790bea08d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:16:57.549853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043edd-0b85-42a0-8f0f-fc790bea08d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:16:57.551317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb043edd-0b85-42a0-8f0f-fc790bea08d7 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:16:57.560338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1235/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:00.960605 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:01.020909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ac1af-8230-40ec-8bbe-2dabe70aed13 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:01.025343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:01.026229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:01.026511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:01.026786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] PATH_INFO: `/v3/users/0a5033847ac04e4b9b45cf3fe14a119e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:01.027956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5033847ac04e4b9b45cf3fe14a119e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:01.029891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:01.216714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5033847ac04e4b9b45cf3fe14a119e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:01.228372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5033847ac04e4b9b45cf3fe14a119e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:01.229209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5033847ac04e4b9b45cf3fe14a119e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:01.235825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5033847ac04e4b9b45cf3fe14a119e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:01.236973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5033847ac04e4b9b45cf3fe14a119e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:01.331971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1232/2467] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:00 2022] DELETE /identity/v3/users/0a5033847ac04e4b9b45cf3fe14a119e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:01.335527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:01.336019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:01.336105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:01.355408 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:01.362085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:01.415554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1236/2468] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:17:01.425642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:01.429794 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:01.488100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559e1e3-dff3-43bd-b599-c20d49d6dad0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:01.491739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:01.492381 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:01.492659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:01.492931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:01.501615 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:01.503084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:01.512107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1233/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:01.908244 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:01.909717 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:01.921688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6b6b9-9b63-4eed-bbb7-f4c5075cdf09 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:01.926768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:01.927617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:01.927905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:01.928336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] PATH_INFO: `/v3/projects/d7de67493e8c41fdb4fbb34ef531130c` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:01.929446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7de67493e8c41fdb4fbb34ef531130c)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:01.931385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:02.054659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7de67493e8c41fdb4fbb34ef531130c', 'request_id': 'req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.123281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7de67493e8c41fdb4fbb34ef531130c', 'request_id': 'req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.129502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7de67493e8c41fdb4fbb34ef531130c', 'request_id': 'req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.140434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] The token cache is being invalidate because project d7de67493e8c41fdb4fbb34ef531130c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:02.140723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.141373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.142969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1237/2470] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:01 2022] DELETE /identity/v3/projects/d7de67493e8c41fdb4fbb34ef531130c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:02.146934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:02.156385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dc7ac-4e4c-4b82-86d4-c4faa3e7f2f7 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:02.209761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:02.210646 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:02.210931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:02.211205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] PATH_INFO: `/v3/users/269b796f42eb4cd388862edc372b660f` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:02.212371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=269b796f42eb4cd388862edc372b660f)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:02.214331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:02.364196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '269b796f42eb4cd388862edc372b660f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.375814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '269b796f42eb4cd388862edc372b660f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.376502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '269b796f42eb4cd388862edc372b660f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.383384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '269b796f42eb4cd388862edc372b660f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.384096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cddee9d2-f975-4fc7-8f7b-171ed3ffe2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '269b796f42eb4cd388862edc372b660f'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:02.456383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1234/2471] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:02 2022] DELETE /identity/v3/users/269b796f42eb4cd388862edc372b660f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:02.861578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:02.863140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:02.876134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb7ab0-93bb-4fc2-a81a-80ce0127f694 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:02.934610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:02.935524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:02.935807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:02.936087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] PATH_INFO: `/v3/projects/c2cd40429ac6450e8953cd8473cbbd20` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:02.937336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2cd40429ac6450e8953cd8473cbbd20)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:02.939899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.049641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2cd40429ac6450e8953cd8473cbbd20', 'request_id': 'req-caa134af-e06f-4c5d-8250-04ecc77200fe'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:03.112258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2cd40429ac6450e8953cd8473cbbd20', 'request_id': 'req-caa134af-e06f-4c5d-8250-04ecc77200fe'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:03.118255 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2cd40429ac6450e8953cd8473cbbd20', 'request_id': 'req-caa134af-e06f-4c5d-8250-04ecc77200fe'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:03.130277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] The token cache is being invalidate because project c2cd40429ac6450e8953cd8473cbbd20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:03.130571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:03.131221 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-caa134af-e06f-4c5d-8250-04ecc77200fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:03.132776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1238/2472] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:02 2022] DELETE /identity/v3/projects/c2cd40429ac6450e8953cd8473cbbd20 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:03.137696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.138088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.138473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.157037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:03.158330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:03.215707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1235/2473] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:17:03.223472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.223766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.224049 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.242258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:03.243666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:03.251405 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1239/2474] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:03.256113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.266422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea2188-d84c-4281-b9d8-69503017d98f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.271709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.272399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.272679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.272951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.273668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:17:03.273978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.275594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.286827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1236/2475] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:17:03.291638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.301258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ac8f4-e8d1-459c-889a-01dd7064cd94 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.305947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.306626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.306907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.307180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.307866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.309759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.382653 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1240/2476] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:03.386823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.396749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050cdef-d70d-4120-9f0f-ade813cdd5fa admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.452951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.453617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.453895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.454197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.454890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.456805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.529231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1237/2477] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:17:03.533290 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.543670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a8b5ed-760d-435d-b48b-dece28ea095f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.554114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.555123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.555513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.555894 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.556772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.558852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.572460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1241/2478] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:03.576277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.587698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530256ab-e3f7-43a4-9902-1a375b67349c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.592810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce18f22-ab53-4ad5-ad33-49ec0268b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.593507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce18f22-ab53-4ad5-ad33-49ec0268b7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.593788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce18f22-ab53-4ad5-ad33-49ec0268b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.594095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce18f22-ab53-4ad5-ad33-49ec0268b7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.595186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce18f22-ab53-4ad5-ad33-49ec0268b7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.596651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce18f22-ab53-4ad5-ad33-49ec0268b7ab admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.610055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1238/2479] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:03.611738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.621767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ddc3b-c861-4b93-89ca-58da955217e4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.627557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.628734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.629099 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.629492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] PATH_INFO: `/v3/projects/26409feaef7049b693177a8a1893e7e7/users/bd4c8b7499bf4051b96c610386caa3f6/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.644919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26409feaef7049b693177a8a1893e7e7, user_id=bd4c8b7499bf4051b96c610386caa3f6, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.647721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.718696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1242/2480] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:03 2022] PUT /identity/v3/projects/26409feaef7049b693177a8a1893e7e7/users/bd4c8b7499bf4051b96c610386caa3f6/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:03.723843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.724134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.728852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.751271 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] MFA Rules not processed for user `bd4c8b7499bf4051b96c610386caa3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:03.752568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:03.813628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1239/2481] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:17:03.818098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.877895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c78be-9540-445b-b0ef-4931cef78017 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:03.882770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:03.883422 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:03.883705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:03.883980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:03.884675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:03.886741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:03.957484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1243/2482] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:17:03.961443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:03.972377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723106e6-0dc9-4c8a-97a6-23287a0e4b97 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:04.025469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:04.026184 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.026468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.026742 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.027425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:04.029362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:04.100451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1240/2483] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:03 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:04.104438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:04.114650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c449d-9012-48de-94fd-2d1f5b9cf153 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:04.119262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:04.119914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.120199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.120475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.121281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:04.122901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:04.133165 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1244/2484] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:04.137060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:04.147519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cf2c6-3541-4b1d-b4f6-0097520fc14b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:04.152115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:04.152979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.153255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.153530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] PATH_INFO: `/v3/projects/4fe64e35c8ea43dbacb1942891a1d9f9/users/a26503d910d444228cd57b026922dd01/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.168557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe64e35c8ea43dbacb1942891a1d9f9, user_id=a26503d910d444228cd57b026922dd01, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:04.171250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:04.243058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1241/2485] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:04 2022] PUT /identity/v3/projects/4fe64e35c8ea43dbacb1942891a1d9f9/users/a26503d910d444228cd57b026922dd01/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:04.247071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:04.256869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31382c-0e33-4eb0-9379-8d1141babc3b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:04.310223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418667a-e3a5-47e3-88dc-e8726230df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:04.310870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418667a-e3a5-47e3-88dc-e8726230df8e admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.311155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418667a-e3a5-47e3-88dc-e8726230df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.311433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418667a-e3a5-47e3-88dc-e8726230df8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.312151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418667a-e3a5-47e3-88dc-e8726230df8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:04.313739 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418667a-e3a5-47e3-88dc-e8726230df8e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:04.323161 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1245/2486] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:17:04.327353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:04.338221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c557e-bf29-4629-8ca7-0034ff5087ce admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:04.346468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:04.347826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.348219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.348678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] PATH_INFO: `/v3/projects/4fe64e35c8ea43dbacb1942891a1d9f9/users/a26503d910d444228cd57b026922dd01/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.350729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe64e35c8ea43dbacb1942891a1d9f9, user_id=a26503d910d444228cd57b026922dd01, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:04.353347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:04.363608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1242/2487] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:04 2022] PUT /identity/v3/projects/4fe64e35c8ea43dbacb1942891a1d9f9/users/a26503d910d444228cd57b026922dd01/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:04.374818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.375114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.375397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.401170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] MFA Rules not processed for user `a26503d910d444228cd57b026922dd01`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:04.402429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:04.468504 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1246/2488] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:04.479079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:04.480761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:04.536591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20422c-36f2-4afd-be9a-07007ffb1f16 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:04.540454 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:04.541090 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:04.541375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:04.541652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:04.595327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:04.597297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:04.606033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1243/2489] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:07.382151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:07.383553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:07.438887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de56fe2-cfe6-4e41-9c1e-fc703897d914 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:07.443073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:07.443721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:07.444008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:07.444313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:07.446139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:07.506420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:07.507848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364c021-9055-4e1a-b9c5-fed524c9618e service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:07.517192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1247/2490] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:10.831044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:10.832464 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:10.843752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fbb2e-b38f-49ae-91a2-4ae391dbeeb8 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:10.847936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:10.848579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:10.848860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:10.849135 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:10.858304 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:10.859740 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:10.869586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1244/2491] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:35.702720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:35.703219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:35.703314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:35.722910 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:35.724180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:35.778705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1248/2492] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:35.938290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:35.939785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:36.005312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b252-2a22-426f-a7d8-12f96371f53e service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:36.010808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10499f5-3ab2-4a8c-8b53-b03fc7806961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:36.011449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10499f5-3ab2-4a8c-8b53-b03fc7806961 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:36.011729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10499f5-3ab2-4a8c-8b53-b03fc7806961 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:36.012002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10499f5-3ab2-4a8c-8b53-b03fc7806961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:36.019839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10499f5-3ab2-4a8c-8b53-b03fc7806961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:36.021417 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10499f5-3ab2-4a8c-8b53-b03fc7806961 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:36.030194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1245/2493] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:17:37.956423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:38.024610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc81668-22a9-4c37-89dc-91d3b0fc1862 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:38.029467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:38.030377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:38.030671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:38.030951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] PATH_INFO: `/v3/users/bd4c8b7499bf4051b96c610386caa3f6` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:38.032286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4c8b7499bf4051b96c610386caa3f6)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:38.034249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:38.208905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4c8b7499bf4051b96c610386caa3f6'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:38.209816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4c8b7499bf4051b96c610386caa3f6'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:38.210628 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4c8b7499bf4051b96c610386caa3f6'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:38.292364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4c8b7499bf4051b96c610386caa3f6'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:38.301110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4c8b7499bf4051b96c610386caa3f6'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:38.323918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1249/2494] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:37 2022] DELETE /identity/v3/users/bd4c8b7499bf4051b96c610386caa3f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:38.328312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187785cd-82ab-460d-868d-eea72d669241 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:38.328816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187785cd-82ab-460d-868d-eea72d669241 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:38.328953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187785cd-82ab-460d-868d-eea72d669241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:38.346870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-187785cd-82ab-460d-868d-eea72d669241 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:38.348091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-187785cd-82ab-460d-868d-eea72d669241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:38.418362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1246/2495] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:38.431554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:38.433038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:38.499839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9acfa7-a554-4f42-9c58-15088de0c8ba admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:38.508004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:38.508619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:38.508905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:38.509182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:38.522998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:38.524458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:38.537032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1250/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:39.394079 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187785cd-82ab-460d-868d-eea72d669241 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:39.396282 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-187785cd-82ab-460d-868d-eea72d669241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:39.418823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187785cd-82ab-460d-868d-eea72d669241 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:39.430112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:39.432663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:39.432949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:39.433221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] PATH_INFO: `/v3/projects/26409feaef7049b693177a8a1893e7e7` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:39.441098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26409feaef7049b693177a8a1893e7e7)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:39.443077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:39.579033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26409feaef7049b693177a8a1893e7e7', 'request_id': 'req-dcf696b3-e36f-4bb3-b78b-e7736309d00c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.587751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26409feaef7049b693177a8a1893e7e7', 'request_id': 'req-dcf696b3-e36f-4bb3-b78b-e7736309d00c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.594670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26409feaef7049b693177a8a1893e7e7', 'request_id': 'req-dcf696b3-e36f-4bb3-b78b-e7736309d00c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.678326 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] The token cache is being invalidate because project 26409feaef7049b693177a8a1893e7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:39.678565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.681433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.683574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1247/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:39 2022] DELETE /identity/v3/projects/26409feaef7049b693177a8a1893e7e7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:39.687515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:39.697538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca73071-9b83-465a-b53b-449217274e6b service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:39.757393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:39.758327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:39.758613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:39.758897 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] PATH_INFO: `/v3/users/a26503d910d444228cd57b026922dd01` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:39.760250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26503d910d444228cd57b026922dd01)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:39.762213 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:39.968286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26503d910d444228cd57b026922dd01'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.968974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26503d910d444228cd57b026922dd01'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:39.969652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26503d910d444228cd57b026922dd01'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.037873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26503d910d444228cd57b026922dd01'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.046410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dce7ebec-1635-4d55-a283-45a487044370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26503d910d444228cd57b026922dd01'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.064883 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1251/2498] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:39 2022] DELETE /identity/v3/users/a26503d910d444228cd57b026922dd01 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:40.592674 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:40.596404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:40.611202 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf696b3-e36f-4bb3-b78b-e7736309d00c admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:40.679039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:40.680484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:40.680941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:40.681224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] PATH_INFO: `/v3/projects/4fe64e35c8ea43dbacb1942891a1d9f9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:40.683052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe64e35c8ea43dbacb1942891a1d9f9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:40.684989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:40.800949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe64e35c8ea43dbacb1942891a1d9f9', 'request_id': 'req-b472b662-61f0-4b31-882d-60e7546bdc9a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.807409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe64e35c8ea43dbacb1942891a1d9f9', 'request_id': 'req-b472b662-61f0-4b31-882d-60e7546bdc9a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.814052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe64e35c8ea43dbacb1942891a1d9f9', 'request_id': 'req-b472b662-61f0-4b31-882d-60e7546bdc9a'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.889041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] The token cache is being invalidate because project 4fe64e35c8ea43dbacb1942891a1d9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:40.890039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.892690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-b472b662-61f0-4b31-882d-60e7546bdc9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:40.895303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1248/2499] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:40 2022] DELETE /identity/v3/projects/4fe64e35c8ea43dbacb1942891a1d9f9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:40.899990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:40.901401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:40.902300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:40.929401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:40.939189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:41.013003 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1252/2500] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:41.020985 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.021277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.021555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.044679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:41.046595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:41.057843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1249/2501] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:41.060542 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.073769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a450f5fb-e105-454c-8f97-511a10f3a95d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.078748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.079475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.084259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.084259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.084259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:17:41.084259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.086741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.102085 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1253/2502] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:17:41.109335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.118770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5833067-883f-46ba-a8b8-77eb1d6fab9e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.128488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.129339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.129631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.129910 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.130633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.132555 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.261673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1250/2503] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:41 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:41.265600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.277947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a9350-3c85-49f1-abaf-f74a3e0b635d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.350115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.350759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.351044 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.351327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.352031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.354272 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.454078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1254/2504] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:41 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:17:41.454550 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.467554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199acad3-b56a-405e-83ed-cbc712a453c0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.472788 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.473460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.473738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.474038 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.474774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.476448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.495355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1251/2505] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:17:41.499517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.513365 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93d77a-1b17-46e7-b54f-ba9be094e6af admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.518492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfeca7d-aa04-4293-8eea-7fcf8d0479ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.519233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeca7d-aa04-4293-8eea-7fcf8d0479ce admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.519569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeca7d-aa04-4293-8eea-7fcf8d0479ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.519924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfeca7d-aa04-4293-8eea-7fcf8d0479ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.520727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfeca7d-aa04-4293-8eea-7fcf8d0479ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.522364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfeca7d-aa04-4293-8eea-7fcf8d0479ce admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.542066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1255/2506] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:41.545843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.556524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9973f3e-33c2-4064-b1f8-ff0a7a75f1b2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.564263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.565249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.565597 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.565940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] PATH_INFO: `/v3/projects/58f6c98ef9c442e3b2149c676e786ae5/users/425dc592e6c648e489e466f3055c197b/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.582964 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f6c98ef9c442e3b2149c676e786ae5, user_id=425dc592e6c648e489e466f3055c197b, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.585915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.678992 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1252/2507] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:41 2022] PUT /identity/v3/projects/58f6c98ef9c442e3b2149c676e786ae5/users/425dc592e6c648e489e466f3055c197b/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:17:41.690288 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.690581 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.690861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.722041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] MFA Rules not processed for user `425dc592e6c648e489e466f3055c197b`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:41.723279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:41.797797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1256/2508] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:41.804492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.875729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35269020-432c-4ee7-8123-8a84bbf48cde admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:41.880707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:41.881371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:41.881659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:41.881923 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:41.882655 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:41.885172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:41.979817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1253/2509] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:41 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:41.981355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:41.992890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185c944-482d-412a-a692-4cfa74b13327 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:42.052369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:42.053040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:42.053327 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:42.053611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:42.054361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:42.056281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:42.495852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1257/2510] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:41 2022] POST /identity/v3/users => generated 300 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:42.499704 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:42.509938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc751c21-9022-4869-b2a0-4d637fd96f68 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:42.514541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:42.515297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:42.515656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:42.515858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:42.516657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:42.518302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:42.528680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1254/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:42.532773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:42.543861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a74d5c-00e1-419d-ba4c-a80eabecc4d4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:42.548527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:42.549419 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:42.549714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:42.550155 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] PATH_INFO: `/v3/projects/4b805f26a5d146df9bad96a83226464f/users/aeb680983c4c4c71a74fe7bb8e894cca/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:42.565264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b805f26a5d146df9bad96a83226464f, user_id=aeb680983c4c4c71a74fe7bb8e894cca, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:42.568154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:42.661265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1258/2512] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:42 2022] PUT /identity/v3/projects/4b805f26a5d146df9bad96a83226464f/users/aeb680983c4c4c71a74fe7bb8e894cca/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:42.670363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:42.677224 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba9063-212f-4819-b3b0-1a94af1e34ad admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:42.749755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83be85-8a7d-4e71-843f-a7769eb2d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:42.750518 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83be85-8a7d-4e71-843f-a7769eb2d8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:42.750814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83be85-8a7d-4e71-843f-a7769eb2d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:42.751095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83be85-8a7d-4e71-843f-a7769eb2d8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:42.751838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83be85-8a7d-4e71-843f-a7769eb2d8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:42.753614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83be85-8a7d-4e71-843f-a7769eb2d8c4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:42.766001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1255/2513] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:42.768670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:42.781605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e379a38-0cdd-4752-b8a8-6c71c40d3e26 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:42.787497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:42.788381 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:42.788663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:42.789196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] PATH_INFO: `/v3/projects/4b805f26a5d146df9bad96a83226464f/users/aeb680983c4c4c71a74fe7bb8e894cca/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:42.791792 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b805f26a5d146df9bad96a83226464f, user_id=aeb680983c4c4c71a74fe7bb8e894cca, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:42.794623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:42.808242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1259/2514] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:42 2022] PUT /identity/v3/projects/4b805f26a5d146df9bad96a83226464f/users/aeb680983c4c4c71a74fe7bb8e894cca/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:42.818210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:42.818711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:42.819152 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:42.850789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] MFA Rules not processed for user `aeb680983c4c4c71a74fe7bb8e894cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:42.852766 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:42.932096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1256/2515] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:42.939421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:42.941326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:43.003677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a702514-c646-4559-b7b7-996d74a4edba admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:43.007713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299244f-d657-4a14-91d8-dfbbf5206666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:43.008369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299244f-d657-4a14-91d8-dfbbf5206666 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:43.008658 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299244f-d657-4a14-91d8-dfbbf5206666 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:43.008940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299244f-d657-4a14-91d8-dfbbf5206666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:43.018746 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299244f-d657-4a14-91d8-dfbbf5206666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:43.020187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299244f-d657-4a14-91d8-dfbbf5206666 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:43.033025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1260/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:43.062386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:43.130609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94ef1-65c5-411c-8384-7eec35efe46d None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:43.136145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:43.137232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:43.137586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:43.137946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] PATH_INFO: `/v3/users/425dc592e6c648e489e466f3055c197b` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:43.139248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425dc592e6c648e489e466f3055c197b)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:43.141357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:43.333248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425dc592e6c648e489e466f3055c197b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:43.350301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425dc592e6c648e489e466f3055c197b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:43.351169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425dc592e6c648e489e466f3055c197b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:43.360489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425dc592e6c648e489e466f3055c197b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:43.361380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425dc592e6c648e489e466f3055c197b'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:43.437098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1257/2517] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:43 2022] DELETE /identity/v3/users/425dc592e6c648e489e466f3055c197b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:43.443951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:43.444224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:43.444500 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:43.468921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:43.470318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:43.564055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1261/2518] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:43.574128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:43.575860 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:43.654171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef5444-9737-4377-8f86-f506927172a1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:43.659502 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:43.660452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:43.660913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:43.661189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:43.674986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:43.676450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:43.687721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1258/2519] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:17:44.468443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:44.470771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:44.486055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306589f5-cb8e-46f9-aae6-e6203660911d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:44.503015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:44.503939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:44.505170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:44.505455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] PATH_INFO: `/v3/projects/58f6c98ef9c442e3b2149c676e786ae5` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:44.507006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f6c98ef9c442e3b2149c676e786ae5)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:44.509179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:44.619901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f6c98ef9c442e3b2149c676e786ae5', 'request_id': 'req-a912c614-012a-4503-83ec-e1e4b1b9ccd8'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:44.688969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f6c98ef9c442e3b2149c676e786ae5', 'request_id': 'req-a912c614-012a-4503-83ec-e1e4b1b9ccd8'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:44.695706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f6c98ef9c442e3b2149c676e786ae5', 'request_id': 'req-a912c614-012a-4503-83ec-e1e4b1b9ccd8'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:44.710526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] The token cache is being invalidate because project 58f6c98ef9c442e3b2149c676e786ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:44.710815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:44.711481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:44.713603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1262/2520] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:44 2022] DELETE /identity/v3/projects/58f6c98ef9c442e3b2149c676e786ae5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:44.717637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:44.727831 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ff681-feaa-421d-9aab-78b167f19a32 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:44.794227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:44.795105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:44.795373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:44.795645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] PATH_INFO: `/v3/users/aeb680983c4c4c71a74fe7bb8e894cca` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:44.796834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb680983c4c4c71a74fe7bb8e894cca)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:44.798805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:45.007800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb680983c4c4c71a74fe7bb8e894cca'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:45.033816 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb680983c4c4c71a74fe7bb8e894cca'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:45.035013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb680983c4c4c71a74fe7bb8e894cca'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:45.047398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb680983c4c4c71a74fe7bb8e894cca'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:45.049405 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bdbfce66-30a9-499b-8b60-792207f4205f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb680983c4c4c71a74fe7bb8e894cca'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:45.129920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1259/2521] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:44 2022] DELETE /identity/v3/users/aeb680983c4c4c71a74fe7bb8e894cca => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:17:45.821761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:45.823284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:45.836670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c614-012a-4503-83ec-e1e4b1b9ccd8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:45.893869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:45.894750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:45.895036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:45.895316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] PATH_INFO: `/v3/projects/4b805f26a5d146df9bad96a83226464f` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:45.896496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b805f26a5d146df9bad96a83226464f)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:45.898437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.034801 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b805f26a5d146df9bad96a83226464f', 'request_id': 'req-df174c64-2370-4726-bcf0-7652c835d348'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:46.111872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b805f26a5d146df9bad96a83226464f', 'request_id': 'req-df174c64-2370-4726-bcf0-7652c835d348'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:46.118338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b805f26a5d146df9bad96a83226464f', 'request_id': 'req-df174c64-2370-4726-bcf0-7652c835d348'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:46.130565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] The token cache is being invalidate because project 4b805f26a5d146df9bad96a83226464f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:46.130855 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:46.131515 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df174c64-2370-4726-bcf0-7652c835d348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:46.137657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1263/2522] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:45 2022] DELETE /identity/v3/projects/4b805f26a5d146df9bad96a83226464f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:46.139247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.139725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.139840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.160967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:46.162567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:46.235473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1260/2523] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:46.237287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.237584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.237865 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.260874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:46.262338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:46.271731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1264/2524] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:46.275641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:46.290914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed915c-ed3a-4866-8b71-335860bf53f9 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:46.298138 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:46.298813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.299098 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.299379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.300144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:17:46.300453 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:46.302092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.320803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1261/2525] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:17:46.325417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:46.335479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff75d-654e-4bcf-998a-d7ea895d2e97 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:46.341371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:46.342671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.343139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.344197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.345211 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:46.347340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.449614 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1265/2526] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:46 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:46.450761 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:46.467371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52806010-aec9-4c38-b426-dade478b962a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:46.533383 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:46.534218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.534499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.534771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.535489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:46.537425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.617312 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1262/2527] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:46 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:46.618558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:46.634193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b7b1-0ab5-427e-bc66-af6fcf906bff admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:46.639754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:46.640432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.640723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.641001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.641752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:46.643391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.655119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1266/2528] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:46.659029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:46.670773 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe445f8-d826-411f-9e1b-e279021893c2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:46.676124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64447c9b-f249-4ca3-814a-f8628a273419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:46.681005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447c9b-f249-4ca3-814a-f8628a273419 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.681005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447c9b-f249-4ca3-814a-f8628a273419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.681005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64447c9b-f249-4ca3-814a-f8628a273419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.681005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64447c9b-f249-4ca3-814a-f8628a273419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:46.681005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64447c9b-f249-4ca3-814a-f8628a273419 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.697254 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1263/2529] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:46.700951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:46.713636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ffe41-ab18-4010-98af-e8d7f6eb1c53 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:46.718836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:46.719713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.720001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.720303 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] PATH_INFO: `/v3/projects/ac33215434394753b85e82f6b3107086/users/ac6862321ae74c86bc9caed5941343e3/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.734974 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac33215434394753b85e82f6b3107086, user_id=ac6862321ae74c86bc9caed5941343e3, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:46.737617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:46.843248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1267/2530] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:46 2022] PUT /identity/v3/projects/ac33215434394753b85e82f6b3107086/users/ac6862321ae74c86bc9caed5941343e3/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:46.862450 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:46.862748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:46.863026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:46.893067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] MFA Rules not processed for user `ac6862321ae74c86bc9caed5941343e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:46.894481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:46.955488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1264/2531] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:46.959990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.021062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd1ac7-d128-420d-b5db-d24cf2d1129e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.025758 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.026469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.026759 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.027040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.027733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.029651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.141614 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1268/2532] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:46 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:47.145582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.156077 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426548b-e951-4630-9112-aee5d3821c81 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.213695 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.214322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.214607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.214959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.215685 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.217706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.311560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1265/2533] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:47 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:17:47.315399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.325565 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24299b8-26f9-4233-aabd-3ca61599c238 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.330412 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.331089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.331376 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.331696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.332413 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.334136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.346037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1269/2534] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:47.350015 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.360251 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d2653-40f2-474f-b445-c60d02d35100 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.364808 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.365660 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.365933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.366229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] PATH_INFO: `/v3/projects/67b995d23dd64a00bd256040b44a41b5/users/d82cb54aab744eefaf65724078b67a3a/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.380238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b995d23dd64a00bd256040b44a41b5, user_id=d82cb54aab744eefaf65724078b67a3a, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.382913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.471670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1266/2535] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:47 2022] PUT /identity/v3/projects/67b995d23dd64a00bd256040b44a41b5/users/d82cb54aab744eefaf65724078b67a3a/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:17:47.475486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.486342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a5676-57fc-4507-b59c-51083125200a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.542992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7099eb-dccd-4d32-aa08-37682441e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.543700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7099eb-dccd-4d32-aa08-37682441e181 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.543946 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7099eb-dccd-4d32-aa08-37682441e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.544228 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7099eb-dccd-4d32-aa08-37682441e181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.544955 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7099eb-dccd-4d32-aa08-37682441e181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.546572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7099eb-dccd-4d32-aa08-37682441e181 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.556392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1270/2536] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:17:47.560577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.571107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb4bf-48ad-42fb-805f-90cedb00f355 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.575903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.576798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.577082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.577378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] PATH_INFO: `/v3/projects/67b995d23dd64a00bd256040b44a41b5/users/d82cb54aab744eefaf65724078b67a3a/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.579515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b995d23dd64a00bd256040b44a41b5, user_id=d82cb54aab744eefaf65724078b67a3a, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.582173 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.596500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1267/2537] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:47 2022] PUT /identity/v3/projects/67b995d23dd64a00bd256040b44a41b5/users/d82cb54aab744eefaf65724078b67a3a/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:47.604114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.605031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.605317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.631040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] MFA Rules not processed for user `d82cb54aab744eefaf65724078b67a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:47.632257 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:47.705220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1271/2538] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:47.714986 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:47.716795 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:47.771150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b837fc-9e72-4b36-af9c-0c8f791a5131 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:47.774864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a191c-a337-40b9-b524-88ac0421a302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:47.775532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a191c-a337-40b9-b524-88ac0421a302 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:47.775815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a191c-a337-40b9-b524-88ac0421a302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:47.776668 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a191c-a337-40b9-b524-88ac0421a302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:47.787110 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a191c-a337-40b9-b524-88ac0421a302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:47.788572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a191c-a337-40b9-b524-88ac0421a302 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:47.798703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1268/2539] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:48.365906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:48.428420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27adf99-00dc-4363-84a2-1cc48786d06b None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:48.433086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:48.433958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:48.434287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:48.434566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] PATH_INFO: `/v3/users/ac6862321ae74c86bc9caed5941343e3` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:48.435798 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6862321ae74c86bc9caed5941343e3)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:48.437781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:48.669826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6862321ae74c86bc9caed5941343e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:48.670702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6862321ae74c86bc9caed5941343e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:48.671387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6862321ae74c86bc9caed5941343e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:48.728633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6862321ae74c86bc9caed5941343e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:48.736747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6862321ae74c86bc9caed5941343e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:48.754697 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1272/2540] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:48 2022] DELETE /identity/v3/users/ac6862321ae74c86bc9caed5941343e3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:48.759164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:48.759998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:48.760918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:48.780687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:48.781924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:48.839121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1269/2541] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:48.848878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:48.850351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:48.905871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bba92c-08b7-4e26-b6b3-07fad0e454bf admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:48.909423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:48.910092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:48.910372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:48.910646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:48.919651 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:48.921071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:48.930237 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1273/2542] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:49.296259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:49.300486 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:49.311847 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a55b1a-a910-4ad5-a3bb-09067532fe12 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:49.316475 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:49.318052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:49.318375 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:49.318593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] PATH_INFO: `/v3/projects/ac33215434394753b85e82f6b3107086` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:49.319778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac33215434394753b85e82f6b3107086)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:49.321833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:49.401764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac33215434394753b85e82f6b3107086', 'request_id': 'req-2e0ca4e0-812b-412c-84ab-b49281022096'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.406980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac33215434394753b85e82f6b3107086', 'request_id': 'req-2e0ca4e0-812b-412c-84ab-b49281022096'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.413033 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac33215434394753b85e82f6b3107086', 'request_id': 'req-2e0ca4e0-812b-412c-84ab-b49281022096'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.459240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] The token cache is being invalidate because project ac33215434394753b85e82f6b3107086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:49.459560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.460171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.462009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1270/2543] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:49 2022] DELETE /identity/v3/projects/ac33215434394753b85e82f6b3107086 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:49.466250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:49.476727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894f371-636d-47ea-84a9-3f8fa4df6361 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:49.533554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:49.534446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:49.534751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:49.535128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] PATH_INFO: `/v3/users/d82cb54aab744eefaf65724078b67a3a` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:49.536316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82cb54aab744eefaf65724078b67a3a)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:49.538298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:49.690742 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82cb54aab744eefaf65724078b67a3a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.691384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82cb54aab744eefaf65724078b67a3a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.692026 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82cb54aab744eefaf65724078b67a3a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.751723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82cb54aab744eefaf65724078b67a3a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.759167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3e06fb33-7f93-4c53-a520-9d25e070ff7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82cb54aab744eefaf65724078b67a3a'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:49.777105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1274/2544] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:17:49 2022] DELETE /identity/v3/users/d82cb54aab744eefaf65724078b67a3a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:50.158895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.158895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:50.177855 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ca4e0-812b-412c-84ab-b49281022096 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.237029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.237885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.238195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.238468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] PATH_INFO: `/v3/projects/67b995d23dd64a00bd256040b44a41b5` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.239626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b995d23dd64a00bd256040b44a41b5)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:50.241565 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:50.385621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b995d23dd64a00bd256040b44a41b5', 'request_id': 'req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:50.391617 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b995d23dd64a00bd256040b44a41b5', 'request_id': 'req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:50.397871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b995d23dd64a00bd256040b44a41b5', 'request_id': 'req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:50.504535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] The token cache is being invalidate because project 67b995d23dd64a00bd256040b44a41b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:17:50.504824 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:50.505500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80a9bf25-47a6-4aa9-9c45-230bbf3f9c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:17:50.507127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1271/2545] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:17:50 2022] DELETE /identity/v3/projects/67b995d23dd64a00bd256040b44a41b5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:50.512654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.513183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.513183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.531758 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:50.532969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:50.588733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1275/2546] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:50.598347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.598630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.598904 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.617634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:50.618803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:50.626622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1272/2547] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:50.630691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.640591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a677776-4613-4ae7-a7de-ba638026d621 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.645556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.646282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.646569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.646960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.647705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:17:50.648022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:50.649656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:50.661834 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1276/2548] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:17:50.666356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.675931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc9ca0-ac4b-4534-ae93-f36b24327c95 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.680604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.687359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.687359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.687359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.687359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:50.687359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:50.750826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1273/2549] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:50 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:50.751716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.762623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285210ff-889b-4069-99a6-c1c80c2400cc admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.818492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.819153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.819491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.819772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.820463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:50.822410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:50.900961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1277/2550] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:50 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:50.905669 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.916257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fbc0b-a4be-40b9-bacb-a09bd77da624 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.920886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.921542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.921822 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.922137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.922853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:50.924478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:50.935451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1274/2551] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:17:50.939009 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.949293 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863ed8f-0e0d-4efb-8051-e9da3369a8ba admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.954423 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7894a5-4b53-4a15-a374-1f820aab46cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.954659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7894a5-4b53-4a15-a374-1f820aab46cc admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.954943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7894a5-4b53-4a15-a374-1f820aab46cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.955218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7894a5-4b53-4a15-a374-1f820aab46cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:50.955975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7894a5-4b53-4a15-a374-1f820aab46cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:50.957551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7894a5-4b53-4a15-a374-1f820aab46cc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:50.968533 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1278/2552] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:50.972678 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:50.983028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40488-57c2-4e01-b60c-facc5370b15a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:50.987974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:50.990775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:50.990775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:50.990775 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] PATH_INFO: `/v3/projects/603cd10542404f29afb6af7443a551bb/users/e08e81613ad640858e0429abfa1789e3/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.004378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=603cd10542404f29afb6af7443a551bb, user_id=e08e81613ad640858e0429abfa1789e3, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.007102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.088801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1275/2553] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:50 2022] PUT /identity/v3/projects/603cd10542404f29afb6af7443a551bb/users/e08e81613ad640858e0429abfa1789e3/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:51.099780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.100071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.100350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.129925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] MFA Rules not processed for user `e08e81613ad640858e0429abfa1789e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:51.130811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:51.199945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1279/2554] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:51.204156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.293747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332749-1e40-46e9-9847-784a47b3bd1d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:51.295522 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:51.296183 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.296461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.296734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.297419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.299456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.363915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1276/2555] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:51 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:51.368034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.379665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1270c-3c72-4f3c-8219-a9573dea55d8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:51.441815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:51.442440 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.442727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.443004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.443705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.445639 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.511388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1280/2556] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:51 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:51.515295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.526332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ce43b-4bbc-4bd0-94f6-6c57972751a4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:51.531318 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:51.531973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.532250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.532521 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.533455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.535083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.548186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1277/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:51.551771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.562517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556224e-6983-4437-8cff-04ec13b502bc admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:51.567281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d4570-c8b2-416b-aeb3-a4cf3b115e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:51.567939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4570-c8b2-416b-aeb3-a4cf3b115e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.568253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4570-c8b2-416b-aeb3-a4cf3b115e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.568530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d4570-c8b2-416b-aeb3-a4cf3b115e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.569260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d4570-c8b2-416b-aeb3-a4cf3b115e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.570913 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d4570-c8b2-416b-aeb3-a4cf3b115e0b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.580747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1281/2558] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:51.584862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.594643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46203cd-c277-42cc-90cf-8b969558d552 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:51.599301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:51.600177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.600481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.600754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] PATH_INFO: `/v3/projects/18c28840f0854685897b326494ac852b/users/70cfe405c1d049fc9420ab08d5bd9967/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.615723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c28840f0854685897b326494ac852b, user_id=70cfe405c1d049fc9420ab08d5bd9967, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.618541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.665845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1278/2559] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:51 2022] PUT /identity/v3/projects/18c28840f0854685897b326494ac852b/users/70cfe405c1d049fc9420ab08d5bd9967/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:51.676525 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.676921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.677206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.703802 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] MFA Rules not processed for user `70cfe405c1d049fc9420ab08d5bd9967`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:51.704914 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:51.766962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1282/2560] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:51.771425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.834408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a2d79-9cae-47a4-9448-d8447b2a18b3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:51.842787 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:51.843492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:51.843782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:51.844054 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:51.844779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:51.846739 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:51.930517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1279/2561] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:17:51 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:51.940851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:51.951702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7080f-334a-4b6e-93b4-662ab9fd1e83 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.006967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.007634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.007921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.008199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.008887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.010832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.082840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1283/2562] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:17:51 2022] POST /identity/v3/users => generated 294 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:17:52.086843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.097600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265df44-e949-4398-add2-d0953ae0d7e8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.102471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.103130 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.103485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.103768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.104488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.106744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.116931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1280/2563] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:52.120827 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.130795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1641241-8a17-492c-916a-d7f335c36bff admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.135481 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.136338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.136614 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.143898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] PATH_INFO: `/v3/projects/bfb23c27a8b54c61a36e3521a4efd2ee/users/6cac43593032422fb005b16b6a7a4300/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.152384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb23c27a8b54c61a36e3521a4efd2ee, user_id=6cac43593032422fb005b16b6a7a4300, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.155052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.243162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1284/2564] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:52 2022] PUT /identity/v3/projects/bfb23c27a8b54c61a36e3521a4efd2ee/users/6cac43593032422fb005b16b6a7a4300/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:52.246976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.257189 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c66e7d-1feb-4f82-952a-c46234a46a3f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.327804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdefef4-b7f0-4dd6-b1a8-8ebeb28bdfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.328546 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdefef4-b7f0-4dd6-b1a8-8ebeb28bdfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.328836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdefef4-b7f0-4dd6-b1a8-8ebeb28bdfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.329116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdefef4-b7f0-4dd6-b1a8-8ebeb28bdfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.329875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdefef4-b7f0-4dd6-b1a8-8ebeb28bdfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.331539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdefef4-b7f0-4dd6-b1a8-8ebeb28bdfc4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.344623 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1281/2565] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:17:52.346499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.357287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c582-46d7-4ae8-bc6f-861b2a0d2b04 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.362643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c78ea-8399-43c3-a592-55d254761895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.363541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c78ea-8399-43c3-a592-55d254761895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.363754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a5839-727a-45d2-aa1c-c0d590e36b56 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.363879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c78ea-8399-43c3-a592-55d254761895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.364041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a5839-727a-45d2-aa1c-c0d590e36b56 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.364169 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c78ea-8399-43c3-a592-55d254761895 admin admin] PATH_INFO: `/v3/projects/bfb23c27a8b54c61a36e3521a4efd2ee/users/6cac43593032422fb005b16b6a7a4300/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.364325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a5839-727a-45d2-aa1c-c0d590e36b56 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.366294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1282/2566] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 26 14:17:52.366549 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c78ea-8399-43c3-a592-55d254761895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb23c27a8b54c61a36e3521a4efd2ee, user_id=6cac43593032422fb005b16b6a7a4300, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.369318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c78ea-8399-43c3-a592-55d254761895 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.371532 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.372208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.372208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.380975 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1285/2567] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:17:52 2022] PUT /identity/v3/projects/bfb23c27a8b54c61a36e3521a4efd2ee/users/6cac43593032422fb005b16b6a7a4300/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:17:52.392907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.393279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.393629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.411602 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:52.412827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:52.422583 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] MFA Rules not processed for user `6cac43593032422fb005b16b6a7a4300`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:52.423890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:52.486448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1283/2568] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:17:52.499380 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.499973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1286/2569] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:17:52.500866 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:52.511317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.512799 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:52.566927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6223aa-3358-495f-aaec-676ff54c7b45 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.570225 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf5ed3-4a0d-4c45-af3b-392a38067810 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.570707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d344a-96fe-408e-9408-8e93512ed2cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.571288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d344a-96fe-408e-9408-8e93512ed2cc service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.571593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d344a-96fe-408e-9408-8e93512ed2cc service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.571854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d344a-96fe-408e-9408-8e93512ed2cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.574150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84974f7-50e4-4fad-a07e-0ad8209562fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.574847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84974f7-50e4-4fad-a07e-0ad8209562fd service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.575102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84974f7-50e4-4fad-a07e-0ad8209562fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.575627 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84974f7-50e4-4fad-a07e-0ad8209562fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.582717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d344a-96fe-408e-9408-8e93512ed2cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.584170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d344a-96fe-408e-9408-8e93512ed2cc service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.595622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1284/2570] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:52.633148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84974f7-50e4-4fad-a07e-0ad8209562fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.634691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84974f7-50e4-4fad-a07e-0ad8209562fd service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.643770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1287/2571] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:17:52.792567 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c49d-da97-4397-868f-3d90c5676e95 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.792890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c49d-da97-4397-868f-3d90c5676e95 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.793174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c49d-da97-4397-868f-3d90c5676e95 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.795182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1285/2572] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:17:52.800222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbc8c-6b9b-4c53-8214-e0619a85484f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.800517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbc8c-6b9b-4c53-8214-e0619a85484f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.800795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbbc8c-6b9b-4c53-8214-e0619a85484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.819480 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-5dbbbc8c-6b9b-4c53-8214-e0619a85484f None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:52.824350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5dbbbc8c-6b9b-4c53-8214-e0619a85484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:52.873608 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1288/2573] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:17:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:52.889147 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c49d-da97-4397-868f-3d90c5676e95 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:52.891106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4937c49d-da97-4397-868f-3d90c5676e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:52.904461 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c49d-da97-4397-868f-3d90c5676e95 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:52.907900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde38761-c57a-4686-98c6-9c6ed058867e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:52.908529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38761-c57a-4686-98c6-9c6ed058867e service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:52.908806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38761-c57a-4686-98c6-9c6ed058867e service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:52.909080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde38761-c57a-4686-98c6-9c6ed058867e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:52.916144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde38761-c57a-4686-98c6-9c6ed058867e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:52.921699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde38761-c57a-4686-98c6-9c6ed058867e service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:52.925770 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1286/2574] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:53.014824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750e173-5054-461c-9629-997311b34330 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:53.017371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750e173-5054-461c-9629-997311b34330 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:53.017371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750e173-5054-461c-9629-997311b34330 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:53.017371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1289/2575] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:17:53.022482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:53.022765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:53.023036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:53.041580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:53.043374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:53.056433 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1287/2576] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:17:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:53.067996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750e173-5054-461c-9629-997311b34330 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:53.069763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7750e173-5054-461c-9629-997311b34330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:53.083159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750e173-5054-461c-9629-997311b34330 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:53.086780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:53.087470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:53.087784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:53.088058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:53.098193 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:53.099599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:53.110645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1290/2577] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:54.650160 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:54.659592 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fca4f-6d9b-4780-b8ef-cba7f15159f0 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:54.663390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82289b54-f2f0-41fa-aac4-b46ada294111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:54.664370 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289b54-f2f0-41fa-aac4-b46ada294111 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:54.664716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289b54-f2f0-41fa-aac4-b46ada294111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:54.665058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82289b54-f2f0-41fa-aac4-b46ada294111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:54.722146 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82289b54-f2f0-41fa-aac4-b46ada294111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:54.723596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82289b54-f2f0-41fa-aac4-b46ada294111 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:54.732941 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1288/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:55.935722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:55.945367 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96055e3e-3141-406f-b203-c9d3580cfb3e service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:55.948962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:55.949594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:55.950081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:55.950362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:55.959409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:55.960987 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:55.970710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1291/2579] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:17:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:17:59.661290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:59.661746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:59.661841 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:59.680690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:17:59.681905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:59.736853 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1289/2580] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:17:59.749181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:17:59.750734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:17:59.819529 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ffa3e-fe8d-4434-bc64-f3161307804e service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:17:59.824613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe43ca-8ceb-41f3-8afc-9e8e5782b963 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:17:59.825214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe43ca-8ceb-41f3-8afc-9e8e5782b963 service swift] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:17:59.825499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe43ca-8ceb-41f3-8afc-9e8e5782b963 service swift] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:17:59.825771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe43ca-8ceb-41f3-8afc-9e8e5782b963 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:17:59.834636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe43ca-8ceb-41f3-8afc-9e8e5782b963 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:17:59.836253 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe43ca-8ceb-41f3-8afc-9e8e5782b963 service swift] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:17:59.845336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1292/2581] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:17:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:00.749108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:00.825385 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812127c-cd64-41cc-97e3-474793adf485 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:00.830283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:00.831196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:00.831472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:00.831741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] PATH_INFO: `/v3/users/e08e81613ad640858e0429abfa1789e3` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:00.832947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08e81613ad640858e0429abfa1789e3)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:00.834942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:01.055991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08e81613ad640858e0429abfa1789e3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:01.077412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08e81613ad640858e0429abfa1789e3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:01.078112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08e81613ad640858e0429abfa1789e3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:01.085662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08e81613ad640858e0429abfa1789e3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:01.086590 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08e81613ad640858e0429abfa1789e3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:01.170303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1290/2582] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:00 2022] DELETE /identity/v3/users/e08e81613ad640858e0429abfa1789e3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:01.174930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:01.175646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:01.175646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:01.193322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:01.194729 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:01.257264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1293/2583] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:01.267425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:01.269070 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:01.347106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82843b-23fd-4d68-a92c-b2f32a7390c7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:01.352702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:01.353444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:01.353785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:01.354172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:01.365448 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:01.366943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:01.377887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1291/2584] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:01.806024 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:01.807807 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:01.823850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e126-cb4c-495d-aca9-ab9d26263048 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:01.830885 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:01.832566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:01.833469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:01.834137 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] PATH_INFO: `/v3/projects/603cd10542404f29afb6af7443a551bb` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:01.835579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=603cd10542404f29afb6af7443a551bb)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:01.837932 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:01.967833 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603cd10542404f29afb6af7443a551bb', 'request_id': 'req-1fe72192-885c-4396-aeec-8c62f6fbb576'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.043017 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603cd10542404f29afb6af7443a551bb', 'request_id': 'req-1fe72192-885c-4396-aeec-8c62f6fbb576'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.049543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603cd10542404f29afb6af7443a551bb', 'request_id': 'req-1fe72192-885c-4396-aeec-8c62f6fbb576'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.060936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] The token cache is being invalidate because project 603cd10542404f29afb6af7443a551bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:02.061220 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.061877 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.063434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1294/2585] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:01 2022] DELETE /identity/v3/projects/603cd10542404f29afb6af7443a551bb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:02.067523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:02.077769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194abc9-2b81-4b51-aab1-4490d084503f service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:02.152019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:02.152900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:02.153181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:02.153455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] PATH_INFO: `/v3/users/70cfe405c1d049fc9420ab08d5bd9967` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:02.162865 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cfe405c1d049fc9420ab08d5bd9967)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:02.165335 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:02.320396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cfe405c1d049fc9420ab08d5bd9967'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.334480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cfe405c1d049fc9420ab08d5bd9967'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.335504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cfe405c1d049fc9420ab08d5bd9967'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.343858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cfe405c1d049fc9420ab08d5bd9967'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.344694 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cfe405c1d049fc9420ab08d5bd9967'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:02.412468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1292/2586] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:02 2022] DELETE /identity/v3/users/70cfe405c1d049fc9420ab08d5bd9967 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:18:02.873202 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:02.875803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:02.892512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe72192-885c-4396-aeec-8c62f6fbb576 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:02.959929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:02.960757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:02.961047 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:02.961325 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] PATH_INFO: `/v3/projects/18c28840f0854685897b326494ac852b` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:02.962606 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c28840f0854685897b326494ac852b)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:02.964634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:03.068544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c28840f0854685897b326494ac852b', 'request_id': 'req-379cffd9-c225-44df-8303-20d2fc2ca6b9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:03.152749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c28840f0854685897b326494ac852b', 'request_id': 'req-379cffd9-c225-44df-8303-20d2fc2ca6b9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:03.159596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c28840f0854685897b326494ac852b', 'request_id': 'req-379cffd9-c225-44df-8303-20d2fc2ca6b9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:03.172106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] The token cache is being invalidate because project 18c28840f0854685897b326494ac852b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:03.172489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:03.173249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:03.175242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1295/2587] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:02 2022] DELETE /identity/v3/projects/18c28840f0854685897b326494ac852b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:03.179257 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:03.187212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:03.208128 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09984e6-928b-4a7f-b123-93da88d94786 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:03.277797 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:03.278733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:03.279036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:03.279353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] PATH_INFO: `/v3/users/6cac43593032422fb005b16b6a7a4300` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:03.280603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cac43593032422fb005b16b6a7a4300)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:03.282599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:04.040112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cac43593032422fb005b16b6a7a4300'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.052182 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cac43593032422fb005b16b6a7a4300'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.053018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cac43593032422fb005b16b6a7a4300'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.060838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cac43593032422fb005b16b6a7a4300'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.061571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-c679521d-4fa1-4eb7-8ce7-b640598df98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cac43593032422fb005b16b6a7a4300'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.141002 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1293/2588] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:03 2022] DELETE /identity/v3/users/6cac43593032422fb005b16b6a7a4300 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:04.604337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:04.606038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:04.620333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cffd9-c225-44df-8303-20d2fc2ca6b9 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:04.698922 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:04.699831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:04.700118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:04.700466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] PATH_INFO: `/v3/projects/bfb23c27a8b54c61a36e3521a4efd2ee` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:04.702392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb23c27a8b54c61a36e3521a4efd2ee)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:04.706803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:04.815884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb23c27a8b54c61a36e3521a4efd2ee', 'request_id': 'req-5869b050-9ee0-40a9-ac8b-05028eab3fec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.883337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb23c27a8b54c61a36e3521a4efd2ee', 'request_id': 'req-5869b050-9ee0-40a9-ac8b-05028eab3fec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.890732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb23c27a8b54c61a36e3521a4efd2ee', 'request_id': 'req-5869b050-9ee0-40a9-ac8b-05028eab3fec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.904055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] The token cache is being invalidate because project bfb23c27a8b54c61a36e3521a4efd2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:04.904351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.905021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5869b050-9ee0-40a9-ac8b-05028eab3fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:04.906650 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1296/2589] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:04 2022] DELETE /identity/v3/projects/bfb23c27a8b54c61a36e3521a4efd2ee => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:04.911645 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:04.912194 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:04.912425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:04.933922 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:04.935838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:04.995996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1294/2590] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:05.004071 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.004498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.004882 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.027219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:05.028512 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:05.042226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1297/2591] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:05.043199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.053743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f60e0-b9e0-4e20-b7c2-a8a57319214e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.058437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.059139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.059432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.059716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.060507 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:18:05.060814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.062452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.074514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1295/2592] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:18:05.079810 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.089154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b316aa-fa78-4f90-b719-613ec5dbfbe8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.096400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.096400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.096679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.096774 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.097462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.099463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.181938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1298/2593] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:05 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:05.186116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.196446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190c946-c5b1-4a39-ae94-47ee8ef2849d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.257581 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.258302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.258591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.258890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.259580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.261531 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.333198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1296/2594] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:05 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:05.334241 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.346326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddc730-fea8-4dfd-a078-d58dec52dbbf admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.352392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.353096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.353358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.353639 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.354450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.356108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.367710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1299/2595] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:18:05.371842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.382743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb55686-f129-4fb0-813a-919ad51670d6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.387416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664709ea-597c-4d7a-81eb-ab84be38d1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.388084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664709ea-597c-4d7a-81eb-ab84be38d1cb admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.388396 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664709ea-597c-4d7a-81eb-ab84be38d1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.388672 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664709ea-597c-4d7a-81eb-ab84be38d1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.389429 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664709ea-597c-4d7a-81eb-ab84be38d1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.391075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664709ea-597c-4d7a-81eb-ab84be38d1cb admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.401392 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1297/2596] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:18:05.407691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.416780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f380b-d273-4014-9b5c-072c2090679b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.422209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.423393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.423685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.423966 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] PATH_INFO: `/v3/projects/9aef30ad618a4d62b590b837bbbcce91/users/1983f8995b2349a69184d3f2ced22b46/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.456969 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aef30ad618a4d62b590b837bbbcce91, user_id=1983f8995b2349a69184d3f2ced22b46, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.461114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.575162 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1300/2597] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:05 2022] PUT /identity/v3/projects/9aef30ad618a4d62b590b837bbbcce91/users/1983f8995b2349a69184d3f2ced22b46/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:05.586638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.587030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.587316 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.628017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] MFA Rules not processed for user `1983f8995b2349a69184d3f2ced22b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:05.629298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:05.702541 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1298/2598] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:05.713541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:05.715318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:05.783684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2643621-62a0-4662-a941-a5e4bc412f92 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:05.787437 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:05.788090 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:05.788382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:05.788677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:05.798342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:05.800170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:05.812676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1301/2599] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:17.259053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:17.260802 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:17.375921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfcd7e-7a5e-4a99-8f31-115678d7776c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:17.381936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952f39b205c74255a2776e7fec3b8643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:17.383584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:17.383951 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:17.384294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:17.387053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:17.400248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:17.403159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64bb8a-8ae7-4d20-8f37-e490899b9fec service placement] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:17.413709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1299/2600] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:17.800747 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:17.802310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:17.866983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f1156-345b-441c-9c17-1cbb8a74ad9a service glance] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:17.871399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:17.872053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:17.872344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:17.872619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:17.874637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:17.940921 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:17.942401 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b984e-836b-4037-928b-be0b58ea9277 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:17.952312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1302/2601] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:18.409114 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:18.409629 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:18.409756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:18.428446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] MFA Rules not processed for user `9cd225533a1e48a3a8f03339af74b851`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:18.429662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:18.489956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1300/2602] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:19.536475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:19.536964 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:19.537087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:19.556128 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:19.557520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:19.642637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1303/2603] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 26 14:18:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:18:19.655435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:19.656978 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:19.744492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3ec4c-6c39-45be-b08e-472648d38c1f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:19.749553 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:19.750921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:19.751207 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:19.751479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:19.760647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:19.762679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:19.773752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1301/2604] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:18:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:22.277613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:22.279139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:22.299195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4bc78-6fce-4109-b83f-d06118773fb6 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:22.299907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:22.300851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:22.301194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:22.301531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] PATH_INFO: `/v3/users/797d50f3ba6244f4a62b3abfa24410d9` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:22.302850 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=797d50f3ba6244f4a62b3abfa24410d9)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:22.304828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:22.531905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '797d50f3ba6244f4a62b3abfa24410d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:22.532712 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '797d50f3ba6244f4a62b3abfa24410d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:22.533348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '797d50f3ba6244f4a62b3abfa24410d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:22.603624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '797d50f3ba6244f4a62b3abfa24410d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:22.613998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-656c52de-528b-4f98-bc66-6f8e2d14dcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '797d50f3ba6244f4a62b3abfa24410d9'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:22.636713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1304/2605] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:22 2022] DELETE /identity/v3/users/797d50f3ba6244f4a62b3abfa24410d9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:22.953416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:22.973096 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489445-52d8-4320-aed0-9bfc86a5cd90 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.061801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.063284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.063643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.064028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] PATH_INFO: `/v3/projects/852d3fc9b96d4019912cc7b5d7e2db73` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.065470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852d3fc9b96d4019912cc7b5d7e2db73)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.067976 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:23.249170 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852d3fc9b96d4019912cc7b5d7e2db73', 'request_id': 'req-80eb507c-c898-4b35-adfe-0164424055c8'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:23.255056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852d3fc9b96d4019912cc7b5d7e2db73', 'request_id': 'req-80eb507c-c898-4b35-adfe-0164424055c8'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:23.261250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852d3fc9b96d4019912cc7b5d7e2db73', 'request_id': 'req-80eb507c-c898-4b35-adfe-0164424055c8'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:23.378582 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] The token cache is being invalidate because project 852d3fc9b96d4019912cc7b5d7e2db73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:23.379013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:23.379879 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-80eb507c-c898-4b35-adfe-0164424055c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:23.382585 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1302/2606] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:22 2022] DELETE /identity/v3/projects/852d3fc9b96d4019912cc7b5d7e2db73 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:23.387888 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.388358 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.388494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.409397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:23.411215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:23.477482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1305/2607] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:18:23.485628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.486009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.486346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.507055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:23.509295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:23.523338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1303/2608] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:23.523544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:23.534265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb6f5d-319d-4c80-85f2-b0f01b337f70 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.541624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.542633 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.542915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.543371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.544120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:18:23.544431 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.546110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:23.558370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1306/2609] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:18:23.562959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:23.572765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82025-fdf8-4d14-8af9-e57b98445844 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.577506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.578762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.579039 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.579309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.579998 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.581899 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:23.684984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1304/2610] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:23 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:23.690179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:23.700625 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed8f52-2eff-4bb7-8cef-b13c672b8763 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.757019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.757695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.758005 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.758420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.759132 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.761057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:23.831385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1307/2611] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:23 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:18:23.835621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:23.846091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2edf-9b71-458b-963d-fd80d592bee4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.850781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.851467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.851751 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.852028 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.852789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.854430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:23.864576 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1305/2612] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:23.868448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:23.878907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1d5e5-0505-4c9c-9275-93dbe72e68b1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.883497 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a83f-0170-4fae-af70-79a9ffd95ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.884138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a83f-0170-4fae-af70-79a9ffd95ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.884450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a83f-0170-4fae-af70-79a9ffd95ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.884700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a83f-0170-4fae-af70-79a9ffd95ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.885446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a83f-0170-4fae-af70-79a9ffd95ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.887019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f190a83f-0170-4fae-af70-79a9ffd95ac8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:23.897321 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1308/2613] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:23.901337 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:23.911091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66c188-7029-4c04-a4fa-938fb218d4ed admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:23.916278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:23.917236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:23.917517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:23.917791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] PATH_INFO: `/v3/projects/58bdc88286df4ac9ab34c68f6fab7bbd/users/6e1e36fb0a264b5ba9299e9e450abc03/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:23.933834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bdc88286df4ac9ab34c68f6fab7bbd, user_id=6e1e36fb0a264b5ba9299e9e450abc03, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:23.936560 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.002604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1306/2614] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:23 2022] PUT /identity/v3/projects/58bdc88286df4ac9ab34c68f6fab7bbd/users/6e1e36fb0a264b5ba9299e9e450abc03/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:24.013204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.013494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.013791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.039831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] MFA Rules not processed for user `6e1e36fb0a264b5ba9299e9e450abc03`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:24.041019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:24.105059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1309/2615] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:24.109904 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.178924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9227e-c1ae-4361-96d7-08be686a0337 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.183698 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.184279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.184561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.184833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.185557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.188120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.322608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1307/2616] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:24 2022] POST /identity/v3/projects => generated 361 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:24.326353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.337078 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72e13e-066b-406d-81ef-8c0d34c1c453 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.393763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.394775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.395082 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.395359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.396060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.397983 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.470604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1310/2617] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:24 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:24.474509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.485644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857bb52-7378-44c7-91d5-402f7a929dc3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.490341 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.490996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.491323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.491600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.492317 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.493918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.503988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1308/2618] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:18:24.507942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.517598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2aeb-2159-4b82-bd82-67d273c507b9 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.522409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.523279 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.523562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.523839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] PATH_INFO: `/v3/projects/d8319f606f224e2f9a5d04e9983733bc/users/5cbcbbf03d534951945ad0e537e8d286/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.539813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8319f606f224e2f9a5d04e9983733bc, user_id=5cbcbbf03d534951945ad0e537e8d286, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.542546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.602010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1311/2619] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:24 2022] PUT /identity/v3/projects/d8319f606f224e2f9a5d04e9983733bc/users/5cbcbbf03d534951945ad0e537e8d286/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:18:24.605800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.616243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d45e2-3d07-4b75-9d60-472e12fcf7d1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.669127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042d05a-cc37-4c37-85f4-9fc1f13cc060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.669807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d05a-cc37-4c37-85f4-9fc1f13cc060 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.670126 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d05a-cc37-4c37-85f4-9fc1f13cc060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.670409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042d05a-cc37-4c37-85f4-9fc1f13cc060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.671121 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d05a-cc37-4c37-85f4-9fc1f13cc060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.673377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042d05a-cc37-4c37-85f4-9fc1f13cc060 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.682747 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1309/2620] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:24.686797 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.697182 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516973-f58f-40ca-93fc-4789a7d40d12 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.704446 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.705330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.705663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.705875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] PATH_INFO: `/v3/projects/d8319f606f224e2f9a5d04e9983733bc/users/5cbcbbf03d534951945ad0e537e8d286/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.707929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8319f606f224e2f9a5d04e9983733bc, user_id=5cbcbbf03d534951945ad0e537e8d286, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.710744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.722468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1312/2621] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:24 2022] PUT /identity/v3/projects/d8319f606f224e2f9a5d04e9983733bc/users/5cbcbbf03d534951945ad0e537e8d286/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:24.732339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.732624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.732902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.758717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] MFA Rules not processed for user `5cbcbbf03d534951945ad0e537e8d286`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:24.759908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:24.824966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1310/2622] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:24.836825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:24.838597 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:24.894103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80792d-a4fb-4630-b68f-a9f343b1b764 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:24.897660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49f846-6a68-42b6-9ace-c99a7a72c76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:24.898323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f846-6a68-42b6-9ace-c99a7a72c76f service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:24.898603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f846-6a68-42b6-9ace-c99a7a72c76f service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:24.898880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49f846-6a68-42b6-9ace-c99a7a72c76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:24.908258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f846-6a68-42b6-9ace-c99a7a72c76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:24.909687 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49f846-6a68-42b6-9ace-c99a7a72c76f service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:24.919460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1313/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:25.694174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:25.756880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3e92-eced-42dd-8969-ec3dfe54ee15 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:25.761467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:25.762374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:25.762717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:25.762970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] PATH_INFO: `/v3/users/6e1e36fb0a264b5ba9299e9e450abc03` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:25.764180 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1e36fb0a264b5ba9299e9e450abc03)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:25.766167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:25.963959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1e36fb0a264b5ba9299e9e450abc03'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:25.976227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1e36fb0a264b5ba9299e9e450abc03'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:25.976926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1e36fb0a264b5ba9299e9e450abc03'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:25.983652 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1e36fb0a264b5ba9299e9e450abc03'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:25.984303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1e36fb0a264b5ba9299e9e450abc03'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:26.059722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1311/2624] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:25 2022] DELETE /identity/v3/users/6e1e36fb0a264b5ba9299e9e450abc03 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:26.065592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:26.066121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:26.066239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:26.083447 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:26.084656 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:26.147673 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1314/2625] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:26.166001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:26.167586 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:26.236295 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68746a16-472d-4eb7-b8e6-877c88997313 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:26.240688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:26.241538 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:26.241823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:26.242129 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:26.256369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:26.258016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:26.269542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1312/2626] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:26.856231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:26.857902 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:26.877270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888ef3f-7b7e-43ce-8e5b-ad28a483903d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:26.889649 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:26.891770 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:26.892239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:26.892674 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] PATH_INFO: `/v3/projects/58bdc88286df4ac9ab34c68f6fab7bbd` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:26.894167 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bdc88286df4ac9ab34c68f6fab7bbd)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:26.896258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:27.066559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bdc88286df4ac9ab34c68f6fab7bbd', 'request_id': 'req-0a7505b5-3640-4b01-80b7-282ac430327e'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.168227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bdc88286df4ac9ab34c68f6fab7bbd', 'request_id': 'req-0a7505b5-3640-4b01-80b7-282ac430327e'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.174637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bdc88286df4ac9ab34c68f6fab7bbd', 'request_id': 'req-0a7505b5-3640-4b01-80b7-282ac430327e'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.185591 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] The token cache is being invalidate because project 58bdc88286df4ac9ab34c68f6fab7bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:27.185879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.186566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.188950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1315/2627] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:26 2022] DELETE /identity/v3/projects/58bdc88286df4ac9ab34c68f6fab7bbd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:27.192842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:27.202452 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfad850-2ec2-4254-8ef6-ed5b67c6172a service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:27.259394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:27.260264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:27.260684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:27.261376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] PATH_INFO: `/v3/users/5cbcbbf03d534951945ad0e537e8d286` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:27.262711 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbcbbf03d534951945ad0e537e8d286)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:27.264745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:27.495782 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbcbbf03d534951945ad0e537e8d286'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.507428 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbcbbf03d534951945ad0e537e8d286'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.508105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbcbbf03d534951945ad0e537e8d286'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.514636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbcbbf03d534951945ad0e537e8d286'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.515310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-35244d49-71c9-4da0-a3b5-27c37b473b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbcbbf03d534951945ad0e537e8d286'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:27.624913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1313/2628] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:27 2022] DELETE /identity/v3/users/5cbcbbf03d534951945ad0e537e8d286 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:28.090527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:28.093354 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:28.106898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7505b5-3640-4b01-80b7-282ac430327e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:28.163178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:28.164284 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.164576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.164861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] PATH_INFO: `/v3/projects/d8319f606f224e2f9a5d04e9983733bc` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.166136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8319f606f224e2f9a5d04e9983733bc)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:28.168036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:28.363094 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8319f606f224e2f9a5d04e9983733bc', 'request_id': 'req-65909ea7-3fcc-4f74-836f-103a82c76b14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:28.482550 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8319f606f224e2f9a5d04e9983733bc', 'request_id': 'req-65909ea7-3fcc-4f74-836f-103a82c76b14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:28.489153 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8319f606f224e2f9a5d04e9983733bc', 'request_id': 'req-65909ea7-3fcc-4f74-836f-103a82c76b14'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:28.500925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] The token cache is being invalidate because project d8319f606f224e2f9a5d04e9983733bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:28.501217 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:28.501852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-65909ea7-3fcc-4f74-836f-103a82c76b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:28.503456 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1316/2629] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:28 2022] DELETE /identity/v3/projects/d8319f606f224e2f9a5d04e9983733bc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:28.508344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.508818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.508933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.526585 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:28.531813 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:28.586109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1314/2630] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:28.593826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.594190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.594477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.613067 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:28.615068 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:28.625248 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1317/2631] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:28.632169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:28.642000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65c99b-b0c5-4018-abe1-ce4a38dde8d1 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:28.646643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:28.647298 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.647578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.647852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.648568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:18:28.648870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:28.650516 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:28.664600 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1315/2632] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:18:28.671461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:28.678122 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32f4c1-e97d-493f-9a56-6d5bf91023ca None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:28.683618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:28.684266 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.684582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.684858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.685551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:28.687587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:28.792961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1318/2633] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:28 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:28.797807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:28.807756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24452ab7-c9a6-4a91-9c6e-69e05b104f07 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:28.864265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:28.864934 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.865319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.865557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.866284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:28.868185 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:28.966480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1316/2634] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:28 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:28.967919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:28.980370 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4d94-3f61-4f80-a971-1126dc89b843 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:28.985903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:28.986612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:28.986899 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:28.987178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:28.990685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:28.990685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.000197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1319/2635] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:29.004327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.014436 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45ec5b-ea1e-44f5-8496-84259c0287fd admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.019084 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a47526-aa28-47f3-9027-469979c74442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.019749 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a47526-aa28-47f3-9027-469979c74442 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.020031 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a47526-aa28-47f3-9027-469979c74442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.020308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a47526-aa28-47f3-9027-469979c74442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.021043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a47526-aa28-47f3-9027-469979c74442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.022680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a47526-aa28-47f3-9027-469979c74442 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.033191 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1317/2636] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:29.040277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.051050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815215d4-2cb8-49d0-b117-fb44b469c5a3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.056062 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.057141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.057490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.058053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] PATH_INFO: `/v3/projects/5fdc749d7631442bb040b0494a906ff5/users/a5fb80635c7c4071ab8afac3076e0553/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.073019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fdc749d7631442bb040b0494a906ff5, user_id=a5fb80635c7c4071ab8afac3076e0553, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.075832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.144790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1320/2637] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:29 2022] PUT /identity/v3/projects/5fdc749d7631442bb040b0494a906ff5/users/a5fb80635c7c4071ab8afac3076e0553/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:29.156119 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.156930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.157214 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.183386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] MFA Rules not processed for user `a5fb80635c7c4071ab8afac3076e0553`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:29.184648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:29.248815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1318/2638] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:29.253298 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.312982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5c8d0-a174-4295-abf5-65e88bd92144 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.317682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.318361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.318646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.318925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.319605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.321484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.414578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1321/2639] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:29 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:29.418511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.429059 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6242c96-d266-4332-8868-e9e962bf1f44 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.483277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.483946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.484230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.484526 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.485311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.487264 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.602206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1319/2640] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:29 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:29.606265 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.616472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc747d19-8a15-45c5-836f-b15cec4bb8aa admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.621134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.621777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.622098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.622373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.623101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.624673 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.635368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1322/2641] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:29.639159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.649690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46efd3c-e4f0-4167-809b-b570837f5fc2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.654397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079def50-8024-4e98-aefd-6936dc7eefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.655067 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079def50-8024-4e98-aefd-6936dc7eefd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.655353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079def50-8024-4e98-aefd-6936dc7eefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.655630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079def50-8024-4e98-aefd-6936dc7eefd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.656349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079def50-8024-4e98-aefd-6936dc7eefd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.657933 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079def50-8024-4e98-aefd-6936dc7eefd9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.667785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1320/2642] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:29.671728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.683204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc1fa-c4b5-4e5c-80c8-565d81064fdb admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.688890 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.689767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.690075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.690353 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] PATH_INFO: `/v3/projects/9da1d1bfa1c6479085a003633c291580/users/02c2bc75b2694ec1814e86674bae756c/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.707072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da1d1bfa1c6479085a003633c291580, user_id=02c2bc75b2694ec1814e86674bae756c, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.709769 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:29.807411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1323/2643] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:29 2022] PUT /identity/v3/projects/9da1d1bfa1c6479085a003633c291580/users/02c2bc75b2694ec1814e86674bae756c/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:29.813480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.813769 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.814075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.840384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] MFA Rules not processed for user `02c2bc75b2694ec1814e86674bae756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:29.841614 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:29.903005 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1321/2644] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:18:29.907843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:29.967133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b1b7e-2c64-4304-a2f5-ce3820070c73 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:29.972016 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:29.972675 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:29.972959 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:29.973235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:29.973927 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:29.975870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.116720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1324/2645] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:29 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:30.117845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:30.128809 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630f451-d38d-4264-ae2e-2fc6a98016b1 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:30.279890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:30.280562 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.280888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.281166 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.282409 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:30.284346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.364444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1322/2646] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:30 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:18:30.368044 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:30.378547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbded18-7055-4719-8ff2-5fb1bc845bf4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:30.387031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:30.387031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.387031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.387031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.387397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:30.387397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.397479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1325/2647] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:30.401352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:30.411583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c1da4-be69-4a1e-8696-962c0a4bd736 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:30.416352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:30.417215 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.417493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.417817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] PATH_INFO: `/v3/projects/90f181b14d5f41e7be0b93c5f75eed54/users/d54f7180330445e8a4a04f61055f1244/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.432825 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f181b14d5f41e7be0b93c5f75eed54, user_id=d54f7180330445e8a4a04f61055f1244, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:30.435511 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.505688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1323/2648] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:30 2022] PUT /identity/v3/projects/90f181b14d5f41e7be0b93c5f75eed54/users/d54f7180330445e8a4a04f61055f1244/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:18:30.509696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:30.519849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cec1e-6fe9-4c4b-83db-9e6cfd8d6e45 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:30.575870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfa175-ad12-45f2-ac7d-75a87a543ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:30.576534 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfa175-ad12-45f2-ac7d-75a87a543ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.576815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfa175-ad12-45f2-ac7d-75a87a543ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.577091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfa175-ad12-45f2-ac7d-75a87a543ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.577847 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfa175-ad12-45f2-ac7d-75a87a543ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:30.579468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfa175-ad12-45f2-ac7d-75a87a543ec9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.589236 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1326/2649] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:18:30.593309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:30.604241 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83437398-abb1-4d9b-af8e-1b5671ed3abb admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:30.609115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:30.610648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.610931 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.611235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] PATH_INFO: `/v3/projects/90f181b14d5f41e7be0b93c5f75eed54/users/d54f7180330445e8a4a04f61055f1244/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.613369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f181b14d5f41e7be0b93c5f75eed54, user_id=d54f7180330445e8a4a04f61055f1244, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:30.616034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.626243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1324/2650] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:30 2022] PUT /identity/v3/projects/90f181b14d5f41e7be0b93c5f75eed54/users/d54f7180330445e8a4a04f61055f1244/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:30.636331 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.636624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.636907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.663516 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] MFA Rules not processed for user `d54f7180330445e8a4a04f61055f1244`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:30.665059 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:30.732109 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1327/2651] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:30.742892 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:30.744625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:30.799944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce72d2-6d5e-45bd-be5f-4b688383aaa9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:30.803534 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:30.804167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:30.804447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:30.804722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:30.813349 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:30.814798 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:30.824112 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1325/2652] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:32.010926 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:32.012477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:32.023990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f82afa-8d77-41e5-8694-ae72f3cdf59d None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:32.027494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:32.028120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:32.028399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:32.028671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:32.083053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:32.084468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:32.093008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1328/2653] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:38.097252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:38.106203 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb475aca-8bae-4ec8-b7ce-52e051310d49 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:38.110334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294b1f5-1f33-4364-bc25-d672fd59e17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:38.114535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b1f5-1f33-4364-bc25-d672fd59e17a service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:38.114535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b1f5-1f33-4364-bc25-d672fd59e17a service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:38.114535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294b1f5-1f33-4364-bc25-d672fd59e17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:38.169619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294b1f5-1f33-4364-bc25-d672fd59e17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:38.171106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294b1f5-1f33-4364-bc25-d672fd59e17a service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:38.180311 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1326/2654] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:39.824418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:39.825887 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:39.889763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab518fa-5abd-4984-a8b9-564b812cd639 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:39.894340 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:39.895203 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:39.895489 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:39.895767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] PATH_INFO: `/v3/users/1983f8995b2349a69184d3f2ced22b46` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:39.896967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1983f8995b2349a69184d3f2ced22b46)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:39.898934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:40.084641 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1983f8995b2349a69184d3f2ced22b46'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.085299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1983f8995b2349a69184d3f2ced22b46'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.085903 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1983f8995b2349a69184d3f2ced22b46'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.144943 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1983f8995b2349a69184d3f2ced22b46'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.151828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1983f8995b2349a69184d3f2ced22b46'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.169661 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1329/2655] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:39 2022] DELETE /identity/v3/users/1983f8995b2349a69184d3f2ced22b46 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:40.174200 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:40.174684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:40.174790 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:40.191309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:40.192626 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:40.248579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1327/2656] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:40.266205 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:40.268189 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:40.322643 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8d92-a3e0-4fbf-8776-4257a326f8d8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:40.326330 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:40.326953 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:40.327235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:40.327509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:40.337360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:40.338823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:40.348390 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1330/2657] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:40.752344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:40.754589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:40.768628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c6311-45c5-4577-931c-655e7bfa6b17 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:40.774137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:40.778750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:40.778750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:40.778750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] PATH_INFO: `/v3/projects/9aef30ad618a4d62b590b837bbbcce91` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:40.780713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aef30ad618a4d62b590b837bbbcce91)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:40.784966 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:40.891756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aef30ad618a4d62b590b837bbbcce91', 'request_id': 'req-4cbc38ec-416f-4502-82a2-6daca53defe5'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.899741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aef30ad618a4d62b590b837bbbcce91', 'request_id': 'req-4cbc38ec-416f-4502-82a2-6daca53defe5'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.908559 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aef30ad618a4d62b590b837bbbcce91', 'request_id': 'req-4cbc38ec-416f-4502-82a2-6daca53defe5'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.995785 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] The token cache is being invalidate because project 9aef30ad618a4d62b590b837bbbcce91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:40.995988 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.996636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4cbc38ec-416f-4502-82a2-6daca53defe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:40.998490 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1328/2658] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:40 2022] DELETE /identity/v3/projects/9aef30ad618a4d62b590b837bbbcce91 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:42.309915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:42.311409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:42.324596 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33892ac-2e24-48dd-8948-c8c40484adc3 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:42.378823 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:42.379677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:42.380012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:42.380263 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] PATH_INFO: `/v3/users/a5fb80635c7c4071ab8afac3076e0553` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:42.381432 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fb80635c7c4071ab8afac3076e0553)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:42.383377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:42.585593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fb80635c7c4071ab8afac3076e0553'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:42.586282 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fb80635c7c4071ab8afac3076e0553'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:42.586916 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fb80635c7c4071ab8afac3076e0553'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:42.665539 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fb80635c7c4071ab8afac3076e0553'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:42.672953 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fb80635c7c4071ab8afac3076e0553'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:42.690425 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1331/2659] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:42 2022] DELETE /identity/v3/users/a5fb80635c7c4071ab8afac3076e0553 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:42.695016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:42.695545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:42.695828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:42.713366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:42.714702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:42.778789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1329/2660] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:42.787663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:42.789569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:42.848346 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f24bd-d4ba-4f1c-99b2-6e4b4db5f161 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:42.851956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:42.852595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:42.853275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:42.853275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:42.862958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:42.864522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:42.874478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1332/2661] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 26 14:18:43.037082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:43.038642 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:43.121715 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e94fe-390c-4318-b668-c24be92d6f26 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:43.128053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:43.128754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:43.129293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:43.129293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:43.131141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:43.144604 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:43.146601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:43.158884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1330/2662] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:43.330559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:43.332942 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:43.350502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af53c6-7009-4d42-8b2b-74db4f2e20aa service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:43.356647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:43.358287 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:43.358618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:43.359073 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] PATH_INFO: `/v3/projects/5fdc749d7631442bb040b0494a906ff5` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:43.361790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fdc749d7631442bb040b0494a906ff5)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:43.364716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:43.512563 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fdc749d7631442bb040b0494a906ff5', 'request_id': 'req-fb2ac775-45b6-4439-a0d6-eef6b1befad7'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.584111 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fdc749d7631442bb040b0494a906ff5', 'request_id': 'req-fb2ac775-45b6-4439-a0d6-eef6b1befad7'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.590455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fdc749d7631442bb040b0494a906ff5', 'request_id': 'req-fb2ac775-45b6-4439-a0d6-eef6b1befad7'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.602487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] The token cache is being invalidate because project 5fdc749d7631442bb040b0494a906ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:43.602776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.606386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.608428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1333/2663] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:43 2022] DELETE /identity/v3/projects/5fdc749d7631442bb040b0494a906ff5 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:43.613221 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:43.624399 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabec99-1cf3-4a33-9868-4551c16a85f2 service nova] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:43.689292 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:43.690222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:43.690512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:43.690791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] PATH_INFO: `/v3/users/02c2bc75b2694ec1814e86674bae756c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:43.692073 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c2bc75b2694ec1814e86674bae756c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:43.694124 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:43.881195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c2bc75b2694ec1814e86674bae756c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.895167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c2bc75b2694ec1814e86674bae756c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.895968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c2bc75b2694ec1814e86674bae756c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.903100 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c2bc75b2694ec1814e86674bae756c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.903887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c2bc75b2694ec1814e86674bae756c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:43.968805 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1331/2664] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:43 2022] DELETE /identity/v3/users/02c2bc75b2694ec1814e86674bae756c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:44.431941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:44.433371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:44.452107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ac775-45b6-4439-a0d6-eef6b1befad7 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:44.504657 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:44.505510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:44.505794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:44.506114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] PATH_INFO: `/v3/projects/9da1d1bfa1c6479085a003633c291580` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:44.507286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da1d1bfa1c6479085a003633c291580)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:44.509159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:44.656945 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da1d1bfa1c6479085a003633c291580', 'request_id': 'req-86f38154-3205-4383-afcf-b89b4f26f56d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:44.755881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da1d1bfa1c6479085a003633c291580', 'request_id': 'req-86f38154-3205-4383-afcf-b89b4f26f56d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:44.761342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da1d1bfa1c6479085a003633c291580', 'request_id': 'req-86f38154-3205-4383-afcf-b89b4f26f56d'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:44.772041 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] The token cache is being invalidate because project 9da1d1bfa1c6479085a003633c291580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:44.778448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:44.778448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:44.778448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1334/2665] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:44 2022] DELETE /identity/v3/projects/9da1d1bfa1c6479085a003633c291580 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:44.778758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:44.780058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:44.793294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241c05e-526b-4fbe-9db7-6c60f6ceb0cf admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:44.847127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:44.848010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:44.848293 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:44.848571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] PATH_INFO: `/v3/users/d54f7180330445e8a4a04f61055f1244` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:44.849754 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54f7180330445e8a4a04f61055f1244)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:44.851730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:45.082134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54f7180330445e8a4a04f61055f1244'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.093366 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54f7180330445e8a4a04f61055f1244'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.094065 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54f7180330445e8a4a04f61055f1244'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.101052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54f7180330445e8a4a04f61055f1244'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.102105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-21cd48d7-217a-493f-be64-c0cfee3d5173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54f7180330445e8a4a04f61055f1244'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.195449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1332/2666] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:44 2022] DELETE /identity/v3/users/d54f7180330445e8a4a04f61055f1244 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:18:45.586474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:45.587928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:45.601703 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f38154-3205-4383-afcf-b89b4f26f56d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:45.656672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:45.658170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:45.658466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:45.658748 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] PATH_INFO: `/v3/projects/90f181b14d5f41e7be0b93c5f75eed54` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:45.659939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f181b14d5f41e7be0b93c5f75eed54)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:45.661839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:45.755872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f181b14d5f41e7be0b93c5f75eed54', 'request_id': 'req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.841979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f181b14d5f41e7be0b93c5f75eed54', 'request_id': 'req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.847607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f181b14d5f41e7be0b93c5f75eed54', 'request_id': 'req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.858786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] The token cache is being invalidate because project 90f181b14d5f41e7be0b93c5f75eed54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:45.858786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.859514 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cf22f3cd-3fb0-463e-b9d1-17a91cf2dc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:45.861022 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1335/2667] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:45 2022] DELETE /identity/v3/projects/90f181b14d5f41e7be0b93c5f75eed54 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:45.866955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:45.867248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:45.867528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:45.885444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:45.886679 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:46.071819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1333/2668] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:18:46.080092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286025-fe09-4237-9903-fb7f10315636 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.080387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286025-fe09-4237-9903-fb7f10315636 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.080671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90286025-fe09-4237-9903-fb7f10315636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.098356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-90286025-fe09-4237-9903-fb7f10315636 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:46.099562 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-90286025-fe09-4237-9903-fb7f10315636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:46.107252 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1336/2669] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:46.111807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.121060 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef2297-ce7f-43ef-b9e7-7c80db467818 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.125564 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.126929 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.127226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.127489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.128201 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:18:46.128504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.130106 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.141320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1334/2670] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:18:46.145700 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90286025-fe09-4237-9903-fb7f10315636 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.154766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90286025-fe09-4237-9903-fb7f10315636 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.159305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.159933 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.160214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.160483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.161190 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.163102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.225688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1337/2671] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:46 2022] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:46.229422 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.239828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca18d2d-1429-4bbb-a4d6-0b3f6c6571b5 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.293235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.293896 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.294211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.294489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.295196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.297058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.401361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1335/2672] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:46 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:46.405578 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.416400 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b70ec-f6d9-4ebf-98a6-897904a5fe0b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.420934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.421579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.423811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.423811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.423811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.425057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.435469 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1338/2673] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:46.439691 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.452001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cef007-e411-45aa-bd92-eb8fa91d9d5f admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.456693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936dcc-d229-4e74-a0f4-5224dc60837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.457339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936dcc-d229-4e74-a0f4-5224dc60837b admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.457616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936dcc-d229-4e74-a0f4-5224dc60837b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.457885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936dcc-d229-4e74-a0f4-5224dc60837b admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.458635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24936dcc-d229-4e74-a0f4-5224dc60837b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.460309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24936dcc-d229-4e74-a0f4-5224dc60837b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.470791 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1336/2674] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:46.474741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.484482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f657948-e807-43b6-b315-9cfb2d51aaa9 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.489559 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.490454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.490736 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.491010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] PATH_INFO: `/v3/projects/c28f52b7372645ba8442661fd47130a9/users/bc1aab714f714ae2bb8f203d23347f1c/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.504996 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28f52b7372645ba8442661fd47130a9, user_id=bc1aab714f714ae2bb8f203d23347f1c, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.507640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.579429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1339/2675] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:46 2022] PUT /identity/v3/projects/c28f52b7372645ba8442661fd47130a9/users/bc1aab714f714ae2bb8f203d23347f1c/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:46.590624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.590913 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.591186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.619058 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] MFA Rules not processed for user `bc1aab714f714ae2bb8f203d23347f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:46.620256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:46.683247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1337/2676] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:46.687844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.746993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c85b5e-12c6-4fe9-bd34-56cbb7b94f30 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.751692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.752380 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.752665 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.752940 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.753626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.755545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:46.883092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1340/2677] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:46 2022] POST /identity/v3/projects => generated 399 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:46.887164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:46.898352 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d9a9e-5346-4ce7-a713-253ba93e1b6e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:46.952473 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:46.953145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:46.953435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:46.953712 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:46.954956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:46.956861 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.104956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1338/2678] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:46 2022] POST /identity/v3/users => generated 306 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:18:47.109106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:47.119360 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e91ff5-c2fa-4ac3-b3a7-61fb5d7e1c27 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:47.123919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:47.124561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.124843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.125116 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.125835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:47.127557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.137804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1341/2679] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:47.141657 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:47.151884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc30e99-b3de-4324-8c95-4aabca4e4024 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:47.156467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:47.157359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.158302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.158578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] PATH_INFO: `/v3/projects/e431b774aa9c4eb3bd3565dcb1fe2611/users/38cd82177e2741e48f8ced93106324e7/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.172671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e431b774aa9c4eb3bd3565dcb1fe2611, user_id=38cd82177e2741e48f8ced93106324e7, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:47.175339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.270681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1339/2680] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:47 2022] PUT /identity/v3/projects/e431b774aa9c4eb3bd3565dcb1fe2611/users/38cd82177e2741e48f8ced93106324e7/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:47.274496 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:47.284306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf78ff7-4c16-4000-866d-0af47e92299d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:47.337304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ee00a-33ec-4cfd-b1e2-40bf095960e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:47.337947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ee00a-33ec-4cfd-b1e2-40bf095960e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.338258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ee00a-33ec-4cfd-b1e2-40bf095960e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.338537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ee00a-33ec-4cfd-b1e2-40bf095960e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.339247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ee00a-33ec-4cfd-b1e2-40bf095960e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:47.340818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ee00a-33ec-4cfd-b1e2-40bf095960e2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.350214 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1342/2681] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:47.354301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:47.364172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df6973-9d96-4e45-bad3-ee0b91cc07e6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:47.368736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:47.369603 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.369885 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.371868 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] PATH_INFO: `/v3/projects/e431b774aa9c4eb3bd3565dcb1fe2611/users/38cd82177e2741e48f8ced93106324e7/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.372155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e431b774aa9c4eb3bd3565dcb1fe2611, user_id=38cd82177e2741e48f8ced93106324e7, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:47.374819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.385142 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1340/2682] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:47 2022] PUT /identity/v3/projects/e431b774aa9c4eb3bd3565dcb1fe2611/users/38cd82177e2741e48f8ced93106324e7/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:47.396509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.396869 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.397208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.423985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] MFA Rules not processed for user `38cd82177e2741e48f8ced93106324e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:47.425245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:47.491342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1343/2683] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:47.502211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:47.504491 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:47.559379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e457c-f53f-435d-9bad-eef3e0c4ffd6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:47.562930 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:47.563594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.563916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.564175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.572900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:47.574377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.583891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1341/2684] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:47.823757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:47.833714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450e4b0-0766-4c3e-9b23-69a06947be47 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:47.837487 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a37a3-89d3-492c-83e1-f00d2e33f9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:47.838156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a37a3-89d3-492c-83e1-f00d2e33f9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:47.838441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a37a3-89d3-492c-83e1-f00d2e33f9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:47.838715 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a37a3-89d3-492c-83e1-f00d2e33f9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:47.894470 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a37a3-89d3-492c-83e1-f00d2e33f9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:47.895895 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a37a3-89d3-492c-83e1-f00d2e33f9c9 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:47.904695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1344/2685] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:53.074291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:53.133421 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeddf53-8904-4608-9a6d-69d6e07801e5 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:53.137918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:53.138807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:53.139116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:53.139389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] PATH_INFO: `/v3/users/bc1aab714f714ae2bb8f203d23347f1c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:53.140563 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1aab714f714ae2bb8f203d23347f1c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:53.142510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:53.345493 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1aab714f714ae2bb8f203d23347f1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:53.357086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1aab714f714ae2bb8f203d23347f1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:53.357746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1aab714f714ae2bb8f203d23347f1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:53.364974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1aab714f714ae2bb8f203d23347f1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:53.365627 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1aab714f714ae2bb8f203d23347f1c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:53.469624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1342/2686] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:53 2022] DELETE /identity/v3/users/bc1aab714f714ae2bb8f203d23347f1c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:53.474962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:53.475461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:53.475566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:53.493329 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:53.494573 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:53.551366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1345/2687] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:53.560893 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:53.562377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:53.617290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc748e8-c245-4afa-8ae1-361a3b6547d3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:53.620821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:53.621457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:53.621737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:53.622057 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:53.631330 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:53.632753 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:53.641862 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1343/2688] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:54.106096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:54.107511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:54.120535 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e505c41-e2ae-4202-bd78-8cdbef7da84f None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:54.125292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:54.126127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:54.126411 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:54.126692 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] PATH_INFO: `/v3/projects/c28f52b7372645ba8442661fd47130a9` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:54.127886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28f52b7372645ba8442661fd47130a9)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:54.130455 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:54.242131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28f52b7372645ba8442661fd47130a9', 'request_id': 'req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.344208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28f52b7372645ba8442661fd47130a9', 'request_id': 'req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.349681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28f52b7372645ba8442661fd47130a9', 'request_id': 'req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.360350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] The token cache is being invalidate because project c28f52b7372645ba8442661fd47130a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:54.361644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.361644 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.363300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1346/2689] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:54 2022] DELETE /identity/v3/projects/c28f52b7372645ba8442661fd47130a9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:54.367470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:54.377000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8125b-fa02-47f5-aeae-8a65630d9a43 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:54.430371 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:54.431225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:54.431506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:54.431778 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] PATH_INFO: `/v3/users/38cd82177e2741e48f8ced93106324e7` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:54.432948 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38cd82177e2741e48f8ced93106324e7)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:54.434943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:54.660196 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38cd82177e2741e48f8ced93106324e7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.671917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38cd82177e2741e48f8ced93106324e7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.675673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38cd82177e2741e48f8ced93106324e7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.680287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38cd82177e2741e48f8ced93106324e7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.680975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-5b6685ea-15cf-4d68-80f7-085305811950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38cd82177e2741e48f8ced93106324e7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:54.772916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1344/2690] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:54 2022] DELETE /identity/v3/users/38cd82177e2741e48f8ced93106324e7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:55.229198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:55.230766 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:55.244222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb1926-344f-4c84-8eed-40da3f2c6b6b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:55.305891 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:55.306815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:55.307219 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:55.307361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] PATH_INFO: `/v3/projects/e431b774aa9c4eb3bd3565dcb1fe2611` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:55.309195 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e431b774aa9c4eb3bd3565dcb1fe2611)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:55.311613 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:55.423316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e431b774aa9c4eb3bd3565dcb1fe2611', 'request_id': 'req-df8e9b48-8d68-4916-9dd8-39f233eef443'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:55.499368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e431b774aa9c4eb3bd3565dcb1fe2611', 'request_id': 'req-df8e9b48-8d68-4916-9dd8-39f233eef443'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:55.505839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e431b774aa9c4eb3bd3565dcb1fe2611', 'request_id': 'req-df8e9b48-8d68-4916-9dd8-39f233eef443'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:55.516682 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] The token cache is being invalidate because project e431b774aa9c4eb3bd3565dcb1fe2611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:55.516971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:55.517604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-df8e9b48-8d68-4916-9dd8-39f233eef443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:55.519163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1347/2691] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:55 2022] DELETE /identity/v3/projects/e431b774aa9c4eb3bd3565dcb1fe2611 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:55.524583 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:55.525051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:55.525167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:55.542430 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:55.543651 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:55.599871 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1345/2692] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:55.607686 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:55.607979 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:55.608258 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:55.626429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:55.627659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:55.636051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1348/2693] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:55.640052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:55.650122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051cfd5-e52f-460a-b51c-70aa610d2073 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:55.654682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:55.655320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:55.655601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:55.655873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:55.656588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:18:55.656890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:55.658504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:55.669663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1346/2694] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:18:55.673553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:55.683102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f60ff1-05b6-4cd7-ab42-202755f3f0c1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:55.687800 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:55.688429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:55.688713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:55.688987 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:55.689683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:55.691604 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:55.836593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1349/2695] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:55 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:55.840771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:55.851071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac20542-80c4-44c6-b48f-cc97d8d2a31b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:55.906844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:55.907535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:55.907821 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:55.908093 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:55.908839 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:55.911019 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.054336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1347/2696] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:55 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:56.058699 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.069726 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7589f1-35c9-4d62-aa7f-b59d9387f7b4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.074322 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.075029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.075339 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.075616 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.076344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.077931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.091816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1350/2697] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 26 14:18:56.094494 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.104856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9e438-c09e-49dd-be96-9a157a07f86b admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.109466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453db76f-1cdb-43d6-a68b-c3aca36def66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.110144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db76f-1cdb-43d6-a68b-c3aca36def66 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.110425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db76f-1cdb-43d6-a68b-c3aca36def66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.110701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453db76f-1cdb-43d6-a68b-c3aca36def66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.111414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453db76f-1cdb-43d6-a68b-c3aca36def66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.112989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453db76f-1cdb-43d6-a68b-c3aca36def66 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.123085 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1348/2698] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:56.129106 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.139261 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ff54a-928a-41e0-8062-21d118a79b7c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.143846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.144716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.144999 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.145304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] PATH_INFO: `/v3/projects/92735198b1a445669bee1c387a240597/users/26fbc6dcaa384133aa5a3b4bad9c5219/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.160177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92735198b1a445669bee1c387a240597, user_id=26fbc6dcaa384133aa5a3b4bad9c5219, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.163433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.264123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1351/2699] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:56 2022] PUT /identity/v3/projects/92735198b1a445669bee1c387a240597/users/26fbc6dcaa384133aa5a3b4bad9c5219/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:56.274398 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.274876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.275249 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.303596 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] MFA Rules not processed for user `26fbc6dcaa384133aa5a3b4bad9c5219`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:56.304880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:56.373462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1349/2700] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:18:56.374761 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.436323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86815cb7-b93c-4674-a06d-3cf17709e2f3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.441223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.441880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.442249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.442557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.443259 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.445164 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.596199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1352/2701] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:18:56 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:56.600664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.611272 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b882a-e5da-4be9-99e3-c1d0a919269b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.665958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.666647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.666926 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.667195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.667870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.669784 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.791332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1350/2702] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:18:56 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:18:56.795276 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.805498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95422f-1157-46c8-a1d3-7de2cb3050f7 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.810204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.812320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.812320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.812320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.812320 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.813730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.825725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1353/2703] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:56.829958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.840726 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aca760-8a4a-4077-94b3-2d048faa1811 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:56.845443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:56.846361 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:56.846639 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:56.846915 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] PATH_INFO: `/v3/projects/eb863a57ba9f430f9c47ad6215b2c8c7/users/67db5bf0228145aab45823d56000e6ce/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:56.866696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb863a57ba9f430f9c47ad6215b2c8c7, user_id=67db5bf0228145aab45823d56000e6ce, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:56.869512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:56.979367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1351/2704] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:56 2022] PUT /identity/v3/projects/eb863a57ba9f430f9c47ad6215b2c8c7/users/67db5bf0228145aab45823d56000e6ce/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:18:56.983386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:56.993335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd1254-3df6-4182-aed8-3171d6170ab3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:57.046992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a10fd-a3d1-4714-9c45-51e37d8b0b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:57.047645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a10fd-a3d1-4714-9c45-51e37d8b0b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:57.047923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a10fd-a3d1-4714-9c45-51e37d8b0b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:57.048201 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a10fd-a3d1-4714-9c45-51e37d8b0b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:57.048930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a10fd-a3d1-4714-9c45-51e37d8b0b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:57.050551 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a10fd-a3d1-4714-9c45-51e37d8b0b19 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:57.059786 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1354/2705] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:18:57.063844 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:57.074281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c561f-f2fc-4b3e-9c69-83c7701ef20a admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:57.078843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:57.079716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:57.079989 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:57.080260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] PATH_INFO: `/v3/projects/eb863a57ba9f430f9c47ad6215b2c8c7/users/67db5bf0228145aab45823d56000e6ce/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:57.082242 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb863a57ba9f430f9c47ad6215b2c8c7, user_id=67db5bf0228145aab45823d56000e6ce, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:57.085462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:57.095382 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1352/2706] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:18:57 2022] PUT /identity/v3/projects/eb863a57ba9f430f9c47ad6215b2c8c7/users/67db5bf0228145aab45823d56000e6ce/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:57.106336 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:57.106566 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:57.106843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:57.132778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] MFA Rules not processed for user `67db5bf0228145aab45823d56000e6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:57.133986 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:57.198317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1355/2707] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:57.212303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:57.214035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:57.268654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d432d-72b7-4bd9-84ef-33d5e1cd26ef admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:57.272277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:57.272903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:57.273239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:57.273519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:57.282278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:57.283737 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:57.293145 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1353/2708] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:57.416846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:57.426918 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc62e1-7366-487d-be05-63a8317129cc None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:57.430508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a5ea-485e-49f6-b175-54617396e064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:57.431198 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a5ea-485e-49f6-b175-54617396e064 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:57.431484 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a5ea-485e-49f6-b175-54617396e064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:57.431760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a5ea-485e-49f6-b175-54617396e064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:57.487555 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a5ea-485e-49f6-b175-54617396e064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:57.489479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a5ea-485e-49f6-b175-54617396e064 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:57.498127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1356/2709] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:57.936309 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:57.997240 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055bda-f342-4fb0-8475-e768a7947fd4 service cinder] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:58.008692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:58.008692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:58.008692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:58.008692 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] PATH_INFO: `/v3/users/26fbc6dcaa384133aa5a3b4bad9c5219` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:58.009127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26fbc6dcaa384133aa5a3b4bad9c5219)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:58.009127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:58.202547 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26fbc6dcaa384133aa5a3b4bad9c5219'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:58.214164 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26fbc6dcaa384133aa5a3b4bad9c5219'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:58.214888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26fbc6dcaa384133aa5a3b4bad9c5219'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:58.221441 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26fbc6dcaa384133aa5a3b4bad9c5219'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:58.222086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26fbc6dcaa384133aa5a3b4bad9c5219'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:58.327156 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1354/2710] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:57 2022] DELETE /identity/v3/users/26fbc6dcaa384133aa5a3b4bad9c5219 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:58.331548 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:58.331866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:58.332140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:58.350866 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:18:58.352055 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:58.412157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1357/2711] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:18:58.422107 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:58.423540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:58.480294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfcbdd-ab0f-4903-bb84-8e4bdce3dce3 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:58.483916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:58.484575 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:58.485540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:58.485540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:58.494108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:58.495745 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:58.505647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1355/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:18:58.918828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:58.920275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:18:58.933856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203d27-426f-4b74-b1b6-5421d8a41a71 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:58.938749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:58.939840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:58.940124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:58.940402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] PATH_INFO: `/v3/projects/92735198b1a445669bee1c387a240597` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:58.941609 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=92735198b1a445669bee1c387a240597)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:58.944305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:59.036825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92735198b1a445669bee1c387a240597', 'request_id': 'req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.116347 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92735198b1a445669bee1c387a240597', 'request_id': 'req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.122864 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92735198b1a445669bee1c387a240597', 'request_id': 'req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.134545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] The token cache is being invalidate because project 92735198b1a445669bee1c387a240597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:18:59.134835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.135524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.137140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1358/2713] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:18:58 2022] DELETE /identity/v3/projects/92735198b1a445669bee1c387a240597 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:18:59.141205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:18:59.151478 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e59f-2a4d-48d8-83a6-2d9d6f2aa2ca service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:18:59.223987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:18:59.224858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:18:59.225134 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:18:59.225401 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] PATH_INFO: `/v3/users/67db5bf0228145aab45823d56000e6ce` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:18:59.226607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67db5bf0228145aab45823d56000e6ce)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:18:59.228764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:18:59.454232 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67db5bf0228145aab45823d56000e6ce'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.466589 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67db5bf0228145aab45823d56000e6ce'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.468227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67db5bf0228145aab45823d56000e6ce'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.475981 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67db5bf0228145aab45823d56000e6ce'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.476699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e6e4a3b9-7850-48b1-8e3d-5898fba16955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67db5bf0228145aab45823d56000e6ce'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:18:59.560218 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1356/2714] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:18:59 2022] DELETE /identity/v3/users/67db5bf0228145aab45823d56000e6ce => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:19:00.049477 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.051076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:00.071873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546f6cb-cdf3-45bd-8498-3ba97026e2ce admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.149518 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.150418 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.150735 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.151004 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] PATH_INFO: `/v3/projects/eb863a57ba9f430f9c47ad6215b2c8c7` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.152222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb863a57ba9f430f9c47ad6215b2c8c7)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:00.154173 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:00.272474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb863a57ba9f430f9c47ad6215b2c8c7', 'request_id': 'req-6872198f-3dfa-4ebd-844d-23ac4e054cc4'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:00.356387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb863a57ba9f430f9c47ad6215b2c8c7', 'request_id': 'req-6872198f-3dfa-4ebd-844d-23ac4e054cc4'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:00.362647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb863a57ba9f430f9c47ad6215b2c8c7', 'request_id': 'req-6872198f-3dfa-4ebd-844d-23ac4e054cc4'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:00.374491 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] The token cache is being invalidate because project eb863a57ba9f430f9c47ad6215b2c8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:19:00.374780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:00.375453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-6872198f-3dfa-4ebd-844d-23ac4e054cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:00.376984 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1359/2715] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:19:00 2022] DELETE /identity/v3/projects/eb863a57ba9f430f9c47ad6215b2c8c7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:19:00.382174 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.382637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.382756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.401635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:00.402943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:00.465780 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1357/2716] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:19:00.477482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.478720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.479014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.499714 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:00.500904 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:00.513314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1360/2717] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:00.513949 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.526362 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7a4e-518c-4b83-b196-4ddb7a26dc9f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.532632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.533353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.533638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.534075 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.534804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:19:00.535111 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:00.537446 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:00.551538 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1358/2718] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 26 14:19:00.555680 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.565835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf744257-4666-49af-b46e-e9a93b3a24d1 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.571856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.572453 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.572738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.573015 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.573749 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:00.576154 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:00.728215 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1361/2719] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:19:00.732537 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.745022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef6f9-7ae5-4096-912b-fbcec787befe admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.807266 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.807950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.808235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.808517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.809205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:00.811162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:00.907936 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1359/2720] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:19:00 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:19:00.909142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.921448 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef7af9-c6e9-49e7-96fc-d4cf0343008b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.926256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.927579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.927924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.928208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.928936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:00.930545 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:00.944114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1362/2721] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:19:00.945308 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.956504 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd238cc-2f3c-49b2-9e6b-ced415ccce10 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.962273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18353d-486e-476a-b064-b0b6ec6afcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.966374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18353d-486e-476a-b064-b0b6ec6afcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.966374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18353d-486e-476a-b064-b0b6ec6afcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.966374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18353d-486e-476a-b064-b0b6ec6afcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:00.966374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18353d-486e-476a-b064-b0b6ec6afcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:00.966374 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18353d-486e-476a-b064-b0b6ec6afcf6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:00.977069 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1360/2722] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:19:00.981421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:00.991450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13349-995e-4a79-973c-6ea6d73f61db admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:00.996194 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:00.997341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:00.997626 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:00.997931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] PATH_INFO: `/v3/projects/7708fced6f6645dd8b7431d9ec158faf/users/23b7fec53b444d66add711d73c3006b3/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:01.014341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7708fced6f6645dd8b7431d9ec158faf, user_id=23b7fec53b444d66add711d73c3006b3, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:01.017076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:01.088465 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1363/2723] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:19:00 2022] PUT /identity/v3/projects/7708fced6f6645dd8b7431d9ec158faf/users/23b7fec53b444d66add711d73c3006b3/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:19:01.099944 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:01.100281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:01.100667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:01.126702 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] MFA Rules not processed for user `23b7fec53b444d66add711d73c3006b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:01.127912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:01.193480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1361/2724] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:01.258151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:01.260177 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:01.318138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80af504-9c38-4c25-b6ac-577e0cd0257b admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:01.321720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4932aeb-a940-4368-b7a6-ffadf9c7b49b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:01.322398 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932aeb-a940-4368-b7a6-ffadf9c7b49b service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:01.322695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932aeb-a940-4368-b7a6-ffadf9c7b49b service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:01.322956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4932aeb-a940-4368-b7a6-ffadf9c7b49b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:01.331086 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4932aeb-a940-4368-b7a6-ffadf9c7b49b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:01.332553 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4932aeb-a940-4368-b7a6-ffadf9c7b49b service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:01.341871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1364/2725] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:19:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:19:01.367056 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:01.432365 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78861716-8e6f-430d-ab18-383d86d2100f None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:01.437680 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:01.438741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:01.439412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:01.439412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] PATH_INFO: `/v3/users/23b7fec53b444d66add711d73c3006b3` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:01.440940 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b7fec53b444d66add711d73c3006b3)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:01.443630 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:01.677231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b7fec53b444d66add711d73c3006b3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:01.688414 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b7fec53b444d66add711d73c3006b3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:01.689082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b7fec53b444d66add711d73c3006b3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:01.696434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b7fec53b444d66add711d73c3006b3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:01.697105 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b7fec53b444d66add711d73c3006b3'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:01.784856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1362/2726] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:19:01 2022] DELETE /identity/v3/users/23b7fec53b444d66add711d73c3006b3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:19:01.789853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:01.790174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:01.790454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:01.808473 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:01.809684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:01.872369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1365/2727] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:01.883250 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:01.890759 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:01.940500 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926151f4-bb8f-49c9-9f26-ca7f1ecca395 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:01.944872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c895648-8b68-4b87-bde7-bb2f1d95b83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:01.945552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895648-8b68-4b87-bde7-bb2f1d95b83e service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:01.945838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895648-8b68-4b87-bde7-bb2f1d95b83e service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:01.946281 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895648-8b68-4b87-bde7-bb2f1d95b83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:01.955377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c895648-8b68-4b87-bde7-bb2f1d95b83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:01.956959 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c895648-8b68-4b87-bde7-bb2f1d95b83e service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:01.966230 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1363/2728] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:19:02.374033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:02.375821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:02.389980 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d124f9f-e222-4ab4-903e-d9655435c1cf None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:02.394289 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:02.395196 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:02.395572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:02.395804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] PATH_INFO: `/v3/projects/7708fced6f6645dd8b7431d9ec158faf` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:02.397019 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7708fced6f6645dd8b7431d9ec158faf)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:02.399002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:02.498585 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7708fced6f6645dd8b7431d9ec158faf', 'request_id': 'req-3fa7eb81-c890-465b-8b38-159574b79073'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:02.596184 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7708fced6f6645dd8b7431d9ec158faf', 'request_id': 'req-3fa7eb81-c890-465b-8b38-159574b79073'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:02.603312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7708fced6f6645dd8b7431d9ec158faf', 'request_id': 'req-3fa7eb81-c890-465b-8b38-159574b79073'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:02.615170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] The token cache is being invalidate because project 7708fced6f6645dd8b7431d9ec158faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:19:02.615461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:02.616131 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-3fa7eb81-c890-465b-8b38-159574b79073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:02.617677 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1366/2729] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:19:02 2022] DELETE /identity/v3/projects/7708fced6f6645dd8b7431d9ec158faf => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:19:02.622916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:02.623408 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:02.623633 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:02.641301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:02.642544 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:02.702029 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1364/2730] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:19:02.710462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:02.710760 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:02.711043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:02.730629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:02.731880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:02.740612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1367/2731] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:02.745013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:02.755746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eab71-5a40-45f4-8c4e-d5859646d1ff None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:02.760635 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:02.761345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:02.761628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:02.761905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:02.762685 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:19:02.762991 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:02.764764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:02.780465 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1365/2732] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:19:02.781960 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:02.791901 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8151da5-0f3c-4987-952c-a4f96f644e10 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:02.796708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:02.797375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:02.797668 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:02.797947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:02.798706 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:02.800636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:02.899454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1368/2733] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:19:02 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:19:02.903887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:02.914741 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351e279-a4c5-4107-b301-cffd8b25bcc8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:02.972353 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:02.973022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:02.973852 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:02.974136 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:02.974814 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:02.976703 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:03.059159 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1366/2734] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:19:02 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:19:03.063197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:03.073239 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67210-a42c-458e-8dbc-d88271573caa admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:03.077787 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:03.078471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:03.078754 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:03.079028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:03.079752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:03.081333 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:03.091530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1369/2735] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:19:03.097671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:03.107864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735b49-9010-4c91-a50c-e8e822fbe482 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:03.112425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa20ef0-3867-4b0e-aa42-1a075f41ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:03.113095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20ef0-3867-4b0e-aa42-1a075f41ecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:03.113373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20ef0-3867-4b0e-aa42-1a075f41ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:03.113643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa20ef0-3867-4b0e-aa42-1a075f41ecc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:03.114927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa20ef0-3867-4b0e-aa42-1a075f41ecc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:03.116499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa20ef0-3867-4b0e-aa42-1a075f41ecc5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:03.126864 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1367/2736] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:19:03.131954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:03.141654 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93376b8-0375-4846-857b-e039c73649d1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:03.146402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:03.147275 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:03.147557 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:03.147836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] PATH_INFO: `/v3/projects/a8edb5a5d03e4e6a9a890cb80a8d07ef/users/aee4742964a94b6eb2e86ce9a7548919/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:03.163337 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8edb5a5d03e4e6a9a890cb80a8d07ef, user_id=aee4742964a94b6eb2e86ce9a7548919, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:03.166267 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:03.299637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1370/2737] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:19:03 2022] PUT /identity/v3/projects/a8edb5a5d03e4e6a9a890cb80a8d07ef/users/aee4742964a94b6eb2e86ce9a7548919/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:19:03.309628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48859070-b2af-4876-804e-d0fa6f17836d None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:03.309938 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48859070-b2af-4876-804e-d0fa6f17836d None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:03.310258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48859070-b2af-4876-804e-d0fa6f17836d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:03.336570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-48859070-b2af-4876-804e-d0fa6f17836d None None] MFA Rules not processed for user `aee4742964a94b6eb2e86ce9a7548919`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:03.337789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-48859070-b2af-4876-804e-d0fa6f17836d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:03.400659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1368/2738] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:03.412264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:03.414058 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:03.480254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5f71-8fb1-4bf1-b523-cf3170b28743 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:03.483992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:03.484777 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:03.485060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:03.485341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:03.494592 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:03.497324 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:03.506936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1371/2739] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:19:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:19:03.809826 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd637e81-be66-43a7-8e05-bcbc5ff1089c None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:03.810325 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd637e81-be66-43a7-8e05-bcbc5ff1089c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:03.810472 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd637e81-be66-43a7-8e05-bcbc5ff1089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:03.828137 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-dd637e81-be66-43a7-8e05-bcbc5ff1089c None None] MFA Rules not processed for user `7bee532aeccf4bfe84c0e984651524dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:03.831539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-dd637e81-be66-43a7-8e05-bcbc5ff1089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:03.881606 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1369/2740] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:06.550541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:06.615526 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4d84e-85fe-4972-919e-1edc15827a82 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:06.620502 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:06.621372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:06.621655 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:06.621930 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] PATH_INFO: `/v3/users/aee4742964a94b6eb2e86ce9a7548919` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:06.623216 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee4742964a94b6eb2e86ce9a7548919)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:06.625133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:06.806441 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee4742964a94b6eb2e86ce9a7548919'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:06.807101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee4742964a94b6eb2e86ce9a7548919'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:06.807824 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee4742964a94b6eb2e86ce9a7548919'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:06.898846 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee4742964a94b6eb2e86ce9a7548919'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:06.906197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee4742964a94b6eb2e86ce9a7548919'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:06.923231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1372/2741] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:19:06 2022] DELETE /identity/v3/users/aee4742964a94b6eb2e86ce9a7548919 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:19:06.928245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:06.928727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:06.928829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:06.946952 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:06.948301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:07.011247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1370/2742] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:07.018197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:07.019623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:07.077811 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441fcc-858b-45de-8680-b0641aeea25f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:07.081389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5156230-e0e6-445b-ab35-678535716845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:07.082060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156230-e0e6-445b-ab35-678535716845 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:07.082341 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156230-e0e6-445b-ab35-678535716845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:07.082620 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5156230-e0e6-445b-ab35-678535716845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:07.091723 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5156230-e0e6-445b-ab35-678535716845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:07.093133 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5156230-e0e6-445b-ab35-678535716845 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:07.103234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1373/2743] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:19:07.644656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:07.646167 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:07.668662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36effb13-c947-4be3-8b66-45f98c332d59 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:07.681471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:07.682378 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:07.682755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:07.683122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] PATH_INFO: `/v3/projects/a8edb5a5d03e4e6a9a890cb80a8d07ef` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:07.684487 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8edb5a5d03e4e6a9a890cb80a8d07ef)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:07.686609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:07.820469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8edb5a5d03e4e6a9a890cb80a8d07ef', 'request_id': 'req-f84742ae-447f-4ed3-9f16-3abca2331864'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:07.826621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8edb5a5d03e4e6a9a890cb80a8d07ef', 'request_id': 'req-f84742ae-447f-4ed3-9f16-3abca2331864'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:07.834574 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8edb5a5d03e4e6a9a890cb80a8d07ef', 'request_id': 'req-f84742ae-447f-4ed3-9f16-3abca2331864'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:08.011558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] The token cache is being invalidate because project a8edb5a5d03e4e6a9a890cb80a8d07ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:19:08.012229 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:08.012577 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-f84742ae-447f-4ed3-9f16-3abca2331864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:19:08.014169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1371/2744] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:19:07 2022] DELETE /identity/v3/projects/a8edb5a5d03e4e6a9a890cb80a8d07ef => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:19:29.330580 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82b81-f42e-40d8-89f0-a49a2c730d07 None None] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:29.331186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82b81-f42e-40d8-89f0-a49a2c730d07 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:29.331186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af82b81-f42e-40d8-89f0-a49a2c730d07 None None] PATH_INFO: `/` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:29.332984 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1374/2745] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:19:29.340083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c31f15-e7ac-4ed5-85e3-f0fde1339c88 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:29.340609 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c31f15-e7ac-4ed5-85e3-f0fde1339c88 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:29.340717 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c31f15-e7ac-4ed5-85e3-f0fde1339c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:29.358746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b8c31f15-e7ac-4ed5-85e3-f0fde1339c88 None None] MFA Rules not processed for user `7b30d840c80a46799c0ac7d70daf0e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:29.359946 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b8c31f15-e7ac-4ed5-85e3-f0fde1339c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:29.409025 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1372/2746] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:29.421163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82b81-f42e-40d8-89f0-a49a2c730d07 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:29.422853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-8af82b81-f42e-40d8-89f0-a49a2c730d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:29.435691 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af82b81-f42e-40d8-89f0-a49a2c730d07 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:29.439192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c71a05-0c07-4789-9d4f-6234599924bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:29.439828 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c71a05-0c07-4789-9d4f-6234599924bd service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:29.440113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c71a05-0c07-4789-9d4f-6234599924bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:29.440393 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c71a05-0c07-4789-9d4f-6234599924bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:29.448270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c71a05-0c07-4789-9d4f-6234599924bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:29.449756 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c71a05-0c07-4789-9d4f-6234599924bd service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:29.457317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1375/2747] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:19:29.541850 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab4b0-3677-4104-a7f1-59321b863f27 None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:29.542231 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab4b0-3677-4104-a7f1-59321b863f27 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:29.542506 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ab4b0-3677-4104-a7f1-59321b863f27 None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:29.544284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1373/2748] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:19:29.549547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:29.549838 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:29.550149 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:29.569180 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:19:29.570417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:29.634299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1376/2749] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:19:29.645367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab4b0-3677-4104-a7f1-59321b863f27 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:19:29.647523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-850ab4b0-3677-4104-a7f1-59321b863f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:19:29.660447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850ab4b0-3677-4104-a7f1-59321b863f27 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:19:29.664006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:19:29.664895 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:19:29.665171 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:19:29.665443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:19:29.675525 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:19:29.677937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:19:29.689641 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1374/2750] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:20:11.443878 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:11.453018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b6d9b-13a4-40da-9843-88c9d303ebbd None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:11.456531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:11.457158 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:11.457530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:11.457812 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:11.459618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:11.473021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:11.474474 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b484f-f9a6-422b-b3a3-5b6187b8888d service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:11.485031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1377/2751] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:20:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:20:12.670637 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:12.679348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56c186-3d9d-43d8-b98a-b7a6f95f5014 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:12.683017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:12.683648 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:12.683932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:12.684199 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:12.685953 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:12.699444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:12.701513 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:12.712580 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1375/2752] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:20:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:20:16.551010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96870-7cc0-4311-bda9-1aa6d289afcb None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:16.551507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96870-7cc0-4311-bda9-1aa6d289afcb None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:16.551610 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e96870-7cc0-4311-bda9-1aa6d289afcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:16.570105 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-92e96870-7cc0-4311-bda9-1aa6d289afcb None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:20:16.571371 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-92e96870-7cc0-4311-bda9-1aa6d289afcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:16.626660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1378/2753] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:20:16.753435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:16.754914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:16.821725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf28fdf-148a-45b7-ac53-00f5bca4c434 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:16.826783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:16.827419 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:16.827697 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:16.827968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:16.835889 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:16.837449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:16.846053 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1376/2754] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:20:18.671350 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:18.671925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:18.671925 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:18.693292 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] MFA Rules not processed for user `9cd225533a1e48a3a8f03339af74b851`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:20:18.694611 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:18.784231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1379/2755] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:20:27.277253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:27.287253 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1c413-0e2d-4478-b48f-7aafd51b9d89 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:27.291519 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:27.292163 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:27.296471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:27.296471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:27.296471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:27.306587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:27.308006 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5645b-4d23-46cb-b7f1-50adda751b91 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:27.317455 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1377/2756] 10.222.0.23 () {60 vars in 1396 bytes} [Tue Apr 26 14:20:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:20:27.869734 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:27.879233 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54ca2b-36de-4971-a109-f2c235fcf978 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:27.882785 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:27.883494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:27.883784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:27.884063 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:27.885825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:27.896784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:27.899462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb2ce1-6473-4fe0-8819-747c0c1a0ce3 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:27.908831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1380/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:20:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:20:33.279905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34f4e-9c88-44af-86c0-061619a3b70c None None] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:33.280757 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34f4e-9c88-44af-86c0-061619a3b70c None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:33.281034 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d34f4e-9c88-44af-86c0-061619a3b70c None None] PATH_INFO: `/` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:33.282842 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1378/2758] 10.222.0.23 () {54 vars in 921 bytes} [Tue Apr 26 14:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 26 14:20:33.289660 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e8d73-a2b1-4874-b75d-04b862af66b0 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:33.290593 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e8d73-a2b1-4874-b75d-04b862af66b0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:33.290881 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e8d73-a2b1-4874-b75d-04b862af66b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:33.313018 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-568e8d73-a2b1-4874-b75d-04b862af66b0 None None] MFA Rules not processed for user `8b647906359a4d8bb2e0cf3098d62967`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:20:33.314270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-568e8d73-a2b1-4874-b75d-04b862af66b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:33.323720 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1381/2759] 10.222.0.23 () {58 vars in 1018 bytes} [Tue Apr 26 14:20:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:20:33.335685 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34f4e-9c88-44af-86c0-061619a3b70c None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:33.337339 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b3d34f4e-9c88-44af-86c0-061619a3b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:33.394139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d34f4e-9c88-44af-86c0-061619a3b70c None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:33.397601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2132fa7fbd034deb938e9032ec710d7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:33.398296 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:33.398579 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:33.398856 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:33.409036 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:33.410505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:33.421725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1379/2760] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:20:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:20:36.066136 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0fa5-2022-43f4-b258-da8e9fa0b574 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:36.066832 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0fa5-2022-43f4-b258-da8e9fa0b574 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:36.067124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0fa5-2022-43f4-b258-da8e9fa0b574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:36.085148 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-fb1a0fa5-2022-43f4-b258-da8e9fa0b574 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:20:36.086379 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-fb1a0fa5-2022-43f4-b258-da8e9fa0b574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:36.094527 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1382/2761] 10.222.0.23 () {58 vars in 1009 bytes} [Tue Apr 26 14:20:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:20:36.107237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:36.118469 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9c78c-bcbf-447e-a214-8c8c1771a066 service glance] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:36.124187 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:36.126050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:36.126050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:36.126050 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:36.133942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:36.135539 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:36.143612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1380/2762] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:20:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:20:50.437460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:50.438013 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:50.438129 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:50.457302 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] MFA Rules not processed for user `ad9df8bc03b54ac5bc828e3343158371`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:20:50.458530 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:20:50.466134 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1383/2763] 10.222.0.23 () {58 vars in 967 bytes} [Tue Apr 26 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:20:50.479437 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:20:50.489524 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b791326-54d1-436b-b50f-abfb39a71ad0 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:20:50.494397 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e24a392a4a96416bb50306d6443036ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:20:50.495047 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:20:50.495338 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:20:50.495607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:20:50.503283 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:20:50.504851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:20:50.513115 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1381/2764] 10.222.0.23 () {60 vars in 1384 bytes} [Tue Apr 26 14:20:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 26 14:21:07.063450 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:07.064835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:07.080110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24672aec-d0b7-4126-befa-3274d22f80b8 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:07.085640 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b647906359a4d8bb2e0cf3098d62967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:07.086315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:07.086602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:07.086880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:07.088602 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:07.101391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:07.103043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:07.114858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1384/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:13.148667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:13.159390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc8ee-b917-4e36-a809-03ad08524cd9 service swift] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:13.164290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:13.165357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:13.165638 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:13.165912 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:13.168372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:13.228967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:13.231081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:13.240523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1382/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:16.954874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:16.956334 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:16.970091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c9af-1879-4216-a934-4ff3ffcc690f service nova] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:16.974721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:16.975541 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:16.975822 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:16.976100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] PATH_INFO: `/v3/users/688c6bd837bf4f1cbde64e64651ff745` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:16.977286 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688c6bd837bf4f1cbde64e64651ff745)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:16.979314 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:17.161104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688c6bd837bf4f1cbde64e64651ff745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.161934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688c6bd837bf4f1cbde64e64651ff745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.162569 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688c6bd837bf4f1cbde64e64651ff745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.237192 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688c6bd837bf4f1cbde64e64651ff745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.244269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688c6bd837bf4f1cbde64e64651ff745'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.262227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1385/2767] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:16 2022] DELETE /identity/v3/users/688c6bd837bf4f1cbde64e64651ff745 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:17.481367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:17.492810 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14612b-5751-4581-bea4-1bc78298afe9 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:17.548045 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:17.548886 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:17.549495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:17.549495 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] PATH_INFO: `/v3/projects/51ea97fcafba4e8fbdd5c7004c94eafe` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:17.550696 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ea97fcafba4e8fbdd5c7004c94eafe)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:17.552588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:17.644290 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ea97fcafba4e8fbdd5c7004c94eafe', 'request_id': 'req-a7456358-1106-4e85-9481-ec036a110837'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.649496 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ea97fcafba4e8fbdd5c7004c94eafe', 'request_id': 'req-a7456358-1106-4e85-9481-ec036a110837'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.655404 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ea97fcafba4e8fbdd5c7004c94eafe', 'request_id': 'req-a7456358-1106-4e85-9481-ec036a110837'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.710734 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] The token cache is being invalidate because project 51ea97fcafba4e8fbdd5c7004c94eafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:17.711022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.711643 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.713169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1383/2768] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:17 2022] DELETE /identity/v3/projects/51ea97fcafba4e8fbdd5c7004c94eafe => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:17.717224 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:17.718634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:17.731599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601333-2523-4f13-b31e-0b6368af5390 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:17.786152 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:17.787012 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:17.787294 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:17.787570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] PATH_INFO: `/v3/users/c4b16de5dea24a5798f0b81cbf3b85ec` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:17.788750 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b16de5dea24a5798f0b81cbf3b85ec)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:17.790967 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:17.987908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b16de5dea24a5798f0b81cbf3b85ec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.988722 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b16de5dea24a5798f0b81cbf3b85ec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:17.989074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b16de5dea24a5798f0b81cbf3b85ec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.054784 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b16de5dea24a5798f0b81cbf3b85ec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.062229 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b16de5dea24a5798f0b81cbf3b85ec'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.078856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1386/2769] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:17 2022] DELETE /identity/v3/users/c4b16de5dea24a5798f0b81cbf3b85ec => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:18.336416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:18.337837 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:18.351064 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7456358-1106-4e85-9481-ec036a110837 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:18.406593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:18.407456 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:18.407736 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:18.408007 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] PATH_INFO: `/v3/projects/05d000457ca74d21815ddae0a2d3f2bc` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:18.409155 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d000457ca74d21815ddae0a2d3f2bc)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:18.411081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:18.518644 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d000457ca74d21815ddae0a2d3f2bc', 'request_id': 'req-26934e60-994d-4e61-ad38-f6f8e7d38695'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.523956 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d000457ca74d21815ddae0a2d3f2bc', 'request_id': 'req-26934e60-994d-4e61-ad38-f6f8e7d38695'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.530570 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d000457ca74d21815ddae0a2d3f2bc', 'request_id': 'req-26934e60-994d-4e61-ad38-f6f8e7d38695'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.598336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] The token cache is being invalidate because project 05d000457ca74d21815ddae0a2d3f2bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:18.598625 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.599244 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:18.600764 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1384/2770] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:18 2022] DELETE /identity/v3/projects/05d000457ca74d21815ddae0a2d3f2bc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:24.430612 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:24.432002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:24.491732 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34394144-8eb7-4c31-8fe5-63e904de3946 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:24.538008 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:24.538652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:24.538936 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:24.539209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:24.541251 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:24.596490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:24.597908 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:24.606690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1387/2771] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:31.904554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:31.905955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:31.960102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26934e60-994d-4e61-ad38-f6f8e7d38695 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:31.963671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:31.964329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:31.964612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:31.964884 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:31.966636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:32.025509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:32.026990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:32.036243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1385/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:35.348245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:35.349690 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:35.364119 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e10b8c-10d2-41a7-85b8-13a9a096be83 service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:35.368727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:35.369587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:35.369872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:35.370814 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] PATH_INFO: `/v3/users/7bee532aeccf4bfe84c0e984651524dc` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:35.372038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bee532aeccf4bfe84c0e984651524dc)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:35.373950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:35.571994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bee532aeccf4bfe84c0e984651524dc'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:35.572662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bee532aeccf4bfe84c0e984651524dc'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:35.573300 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bee532aeccf4bfe84c0e984651524dc'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:35.639032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bee532aeccf4bfe84c0e984651524dc'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:35.646021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-0c1bd66f-507c-405f-9c8c-95a8181638c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bee532aeccf4bfe84c0e984651524dc'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:35.663417 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1388/2773] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:35 2022] DELETE /identity/v3/users/7bee532aeccf4bfe84c0e984651524dc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:35.903801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:35.914212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fad558-8b33-4c7b-98fa-9e3083927b69 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:35.971243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:35.972101 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:35.972384 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:35.972664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] PATH_INFO: `/v3/projects/ceae37df7abe4226ab88abbc1d289a5c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:35.973846 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceae37df7abe4226ab88abbc1d289a5c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:35.975776 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.088089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceae37df7abe4226ab88abbc1d289a5c', 'request_id': 'req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:36.093954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceae37df7abe4226ab88abbc1d289a5c', 'request_id': 'req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:36.099781 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceae37df7abe4226ab88abbc1d289a5c', 'request_id': 'req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:36.180434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] The token cache is being invalidate because project ceae37df7abe4226ab88abbc1d289a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:36.180659 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:36.181313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6a5db3fd-64c8-40ec-82a9-dafd39cdc22d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:36.183489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1386/2774] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:35 2022] DELETE /identity/v3/projects/ceae37df7abe4226ab88abbc1d289a5c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:36.188483 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.188775 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.189052 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.206937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:36.208146 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:36.264848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1389/2775] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:36.273091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.273379 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.273658 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.291536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:36.293245 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:36.301041 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1387/2776] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:36.304947 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.314956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3580981-dcbb-456f-8a00-215144d9a0bc None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.319510 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.320147 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.320429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.320705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.321430 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:21:36.321737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.323373 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.334451 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1390/2777] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:21:36.338310 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.347690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae934789-9184-4dd9-8dc3-ca69f497d6b5 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.352294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.352928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.353212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.353484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.354210 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.356722 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.443345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1388/2778] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:36 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:36.444468 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.454506 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75d08e-2f7c-4333-808b-ee13c201843a admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.509454 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.510145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.510434 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.510767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.511457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.513389 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.621595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1391/2779] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:36 2022] POST /identity/v3/users => generated 302 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 26 14:21:36.625690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.635901 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b045a-edf0-4ae5-a181-abe8fb9d78b9 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.640512 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.641158 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.641443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.641719 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.642568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.644175 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.654914 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1389/2780] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:36.658795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.669836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcd0c3-0c75-4b11-bf80-3c5bd41b2d60 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.674537 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d604e-ee12-41da-b1a7-d643038433fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.675212 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d604e-ee12-41da-b1a7-d643038433fd admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.675494 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d604e-ee12-41da-b1a7-d643038433fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.675875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d604e-ee12-41da-b1a7-d643038433fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.676605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d604e-ee12-41da-b1a7-d643038433fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.678256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d604e-ee12-41da-b1a7-d643038433fd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.688159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1392/2781] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:36.692216 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.702709 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a870335-bbb4-4da6-ab14-693471c1b2d6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.707261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.708139 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.708424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.708701 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] PATH_INFO: `/v3/projects/7c48ecc2f6d3404baadd77f09adc44c7/users/e609e2ba6f324913abb95f8fe7ccb20c/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.723226 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c48ecc2f6d3404baadd77f09adc44c7, user_id=e609e2ba6f324913abb95f8fe7ccb20c, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.725874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:36.786902 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1390/2782] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:36 2022] PUT /identity/v3/projects/7c48ecc2f6d3404baadd77f09adc44c7/users/e609e2ba6f324913abb95f8fe7ccb20c/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:36.798806 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.799145 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.799421 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.825410 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] MFA Rules not processed for user `e609e2ba6f324913abb95f8fe7ccb20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:36.826645 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:36.886906 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1393/2783] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:36.891237 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:36.951968 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae47f11-8356-4e26-855c-50450c8178b4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:36.956681 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:36.957273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:36.957554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:36.957827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:36.958545 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:36.960434 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.034662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1391/2784] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:36 2022] POST /identity/v3/projects => generated 403 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:37.039197 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.050006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5c4b0-87ff-4389-94eb-9b52f0648587 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.103486 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.104142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.104457 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.104737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.105409 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.107335 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.227420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1394/2785] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:37 2022] POST /identity/v3/users => generated 308 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:37.231300 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.241640 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a380c50-ef1e-4894-83ea-6866b545fe72 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.246894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.247540 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.247819 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.248089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.248827 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.250529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.260083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1392/2786] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:37.264853 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.274702 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f887e29-8ecb-40df-9967-699994aa6cc8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.279382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.280234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.280517 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.280790 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] PATH_INFO: `/v3/projects/f93fb47c72764e57aea6063569665f59/users/791ecf66d5f84a97ae96c19991a80e1e/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.295156 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93fb47c72764e57aea6063569665f59, user_id=791ecf66d5f84a97ae96c19991a80e1e, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.298001 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.376387 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1395/2787] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:37 2022] PUT /identity/v3/projects/f93fb47c72764e57aea6063569665f59/users/791ecf66d5f84a97ae96c19991a80e1e/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:21:37.380449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.390332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383287d-0699-4c79-b11c-918e711cd2e7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.444558 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150b25a-260b-457f-8e88-5f66e4dd7fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.444925 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b25a-260b-457f-8e88-5f66e4dd7fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.445209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b25a-260b-457f-8e88-5f66e4dd7fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.445488 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150b25a-260b-457f-8e88-5f66e4dd7fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.446236 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150b25a-260b-457f-8e88-5f66e4dd7fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.448479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0150b25a-260b-457f-8e88-5f66e4dd7fa5 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.458314 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1393/2788] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:37.462623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.473498 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf5cd9-5afb-4c0f-8ade-ba9d4d2a29c3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.480482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.480482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.480482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.480482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] PATH_INFO: `/v3/projects/f93fb47c72764e57aea6063569665f59/users/791ecf66d5f84a97ae96c19991a80e1e/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.481508 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93fb47c72764e57aea6063569665f59, user_id=791ecf66d5f84a97ae96c19991a80e1e, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.484186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.494270 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1396/2789] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:37 2022] PUT /identity/v3/projects/f93fb47c72764e57aea6063569665f59/users/791ecf66d5f84a97ae96c19991a80e1e/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:37.504313 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.504607 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.504900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.531840 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] MFA Rules not processed for user `791ecf66d5f84a97ae96c19991a80e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:37.533043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:37.597278 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1394/2790] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:37.608072 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.609730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:37.664861 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cad01d-c0ba-4705-9cca-391d90c774f0 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.668575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b377a95-2a25-45ff-9da0-6640dbd968f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.669206 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377a95-2a25-45ff-9da0-6640dbd968f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.669492 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377a95-2a25-45ff-9da0-6640dbd968f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.669771 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b377a95-2a25-45ff-9da0-6640dbd968f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.678622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377a95-2a25-45ff-9da0-6640dbd968f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.680048 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b377a95-2a25-45ff-9da0-6640dbd968f3 service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:37.689357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1397/2791] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:37.814664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:37.873599 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376c8b8-c1d1-40a3-b115-2d7e41402f36 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:37.878108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:37.878960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:37.879238 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:37.879515 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] PATH_INFO: `/v3/users/e609e2ba6f324913abb95f8fe7ccb20c` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:37.880690 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e609e2ba6f324913abb95f8fe7ccb20c)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:37.882650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:38.051834 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e609e2ba6f324913abb95f8fe7ccb20c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.062965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e609e2ba6f324913abb95f8fe7ccb20c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.063656 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e609e2ba6f324913abb95f8fe7ccb20c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.070217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e609e2ba6f324913abb95f8fe7ccb20c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.070836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e609e2ba6f324913abb95f8fe7ccb20c'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.122273 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1395/2792] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:37 2022] DELETE /identity/v3/users/e609e2ba6f324913abb95f8fe7ccb20c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:38.126745 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:38.127034 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:38.127307 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:38.145571 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:38.146803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:38.203639 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1398/2793] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:38.213424 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:38.215425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:38.269730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786eb9-2e8c-4d16-8d2b-75598f8a8029 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:38.273373 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:38.274032 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:38.274315 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:38.274587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:38.283996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:38.285447 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:38.295235 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1396/2794] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:38.691767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:38.693315 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:38.706919 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b67b-99ea-4fc1-9843-2fcacdfb17da None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:38.712247 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:38.713114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:38.713399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:38.714306 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] PATH_INFO: `/v3/projects/7c48ecc2f6d3404baadd77f09adc44c7` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:38.715544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c48ecc2f6d3404baadd77f09adc44c7)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:38.717464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:38.825010 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c48ecc2f6d3404baadd77f09adc44c7', 'request_id': 'req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.905647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c48ecc2f6d3404baadd77f09adc44c7', 'request_id': 'req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.911163 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c48ecc2f6d3404baadd77f09adc44c7', 'request_id': 'req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.923382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] The token cache is being invalidate because project 7c48ecc2f6d3404baadd77f09adc44c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:38.923672 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.924311 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:38.925840 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1399/2795] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:38 2022] DELETE /identity/v3/projects/7c48ecc2f6d3404baadd77f09adc44c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:38.929779 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:38.939061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6abbc7-d709-447f-b498-cb808807ad93 service neutron] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:38.993340 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:38.994258 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:38.994535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:38.994804 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] PATH_INFO: `/v3/users/791ecf66d5f84a97ae96c19991a80e1e` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:38.995967 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] RBAC: Authorizing `identity:delete_user(user_id=791ecf66d5f84a97ae96c19991a80e1e)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:38.997908 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:39.152973 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791ecf66d5f84a97ae96c19991a80e1e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.164233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791ecf66d5f84a97ae96c19991a80e1e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.165149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791ecf66d5f84a97ae96c19991a80e1e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.171731 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791ecf66d5f84a97ae96c19991a80e1e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.172355 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-208f6ce1-c547-495c-b95d-257f8899015c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791ecf66d5f84a97ae96c19991a80e1e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.243890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1397/2796] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:38 2022] DELETE /identity/v3/users/791ecf66d5f84a97ae96c19991a80e1e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:39.663391 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:39.665118 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:39.689098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd9a4e-daa0-468b-b6f4-1dc48070708f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:39.733467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:39.734394 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:39.734659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:39.734939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] PATH_INFO: `/v3/projects/f93fb47c72764e57aea6063569665f59` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:39.736123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93fb47c72764e57aea6063569665f59)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:39.738043 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:39.861794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93fb47c72764e57aea6063569665f59', 'request_id': 'req-2da5e5b3-e81c-443d-b080-468617628da3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.930006 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93fb47c72764e57aea6063569665f59', 'request_id': 'req-2da5e5b3-e81c-443d-b080-468617628da3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.936091 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93fb47c72764e57aea6063569665f59', 'request_id': 'req-2da5e5b3-e81c-443d-b080-468617628da3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.946741 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] The token cache is being invalidate because project f93fb47c72764e57aea6063569665f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:39.947036 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.956249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-2da5e5b3-e81c-443d-b080-468617628da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:39.956249 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1400/2797] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:39 2022] DELETE /identity/v3/projects/f93fb47c72764e57aea6063569665f59 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:39.956468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:39.956468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:39.956468 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:39.971714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:39.972927 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:40.030662 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1398/2798] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:40.038364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.038652 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.038929 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.058436 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:40.059624 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:40.067342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1401/2799] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:40.071367 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.080815 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e8f06-6a9c-40c8-8a24-f4120428a4e6 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.085280 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.085916 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.086227 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.086498 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.087209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80042) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:21:40.087510 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.089634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.100803 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1399/2800] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:21:40.105595 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.114630 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e3635-6580-404e-bda8-a78b91f3f2e6 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.119226 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.119872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.120151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.120426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.121110 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.123033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.234939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1402/2801] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:40.238796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.248649 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb30adf-67d3-4dd5-9efb-308f1e0da5a2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.301801 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.302479 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.302763 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.303037 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.303716 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.305624 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.417275 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1400/2802] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:40 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:40.421366 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.431618 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca94e-7937-410a-8aa2-f8ba0f0ef2ab admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.436524 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.437990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.437990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.437990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.438503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.440107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.451458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1403/2803] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:40.455389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.465756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0d13e-72d6-4037-aefd-b5894fab88e4 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.470344 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f69fe-fa53-4f2c-adc8-98a5cd7997ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.471020 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f69fe-fa53-4f2c-adc8-98a5cd7997ad admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.471301 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f69fe-fa53-4f2c-adc8-98a5cd7997ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.471572 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f69fe-fa53-4f2c-adc8-98a5cd7997ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.472287 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f69fe-fa53-4f2c-adc8-98a5cd7997ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.474000 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f69fe-fa53-4f2c-adc8-98a5cd7997ad admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.483535 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1401/2804] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:40.487547 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.497598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1fb35-a207-4498-b998-0d8bedcb5fe6 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.502256 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.503114 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.503392 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.503669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] PATH_INFO: `/v3/projects/fb44a9c360ef46ab89ecc4fe873fd6a9/users/eef03a14617b4528a0ed9fd86b2d3074/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.518364 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb44a9c360ef46ab89ecc4fe873fd6a9, user_id=eef03a14617b4528a0ed9fd86b2d3074, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.520976 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.580281 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1404/2805] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:40 2022] PUT /identity/v3/projects/fb44a9c360ef46ab89ecc4fe873fd6a9/users/eef03a14617b4528a0ed9fd86b2d3074/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:40.592389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.592673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.592950 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.618426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] MFA Rules not processed for user `eef03a14617b4528a0ed9fd86b2d3074`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:40.619619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:40.680359 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1402/2806] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:40.684931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.744521 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e455f90-0926-44b6-a194-6d68010d25fc admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.749108 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.749753 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.750138 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.750420 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.751102 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.752992 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:40.852191 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1405/2807] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:40 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:40.856012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:40.866721 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347635d5-ca21-45f3-881c-220db62581d4 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:40.921012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:40.921671 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:40.921955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:40.922256 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] PATH_INFO: `/v3/users` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:40.922943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:40.924854 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:41.033279 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1403/2808] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:40 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:41.037199 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:41.047637 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d6c6a-ab27-4dc2-8bbb-1a0cb097e572 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:41.052174 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:41.052818 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:41.053100 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:41.053375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:41.054130 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:41.055778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:41.066570 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1406/2809] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:41.070714 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:41.081186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee30ede-8f73-46c6-92f3-8d526c20b012 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:41.085783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:41.086684 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:41.086965 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:41.087239 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] PATH_INFO: `/v3/projects/9af8aed48a8d4c0fbd3c357d471dbe5f/users/d59a218d652340eda8fcf124a8cae5c1/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:41.101390 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af8aed48a8d4c0fbd3c357d471dbe5f, user_id=d59a218d652340eda8fcf124a8cae5c1, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:41.104120 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:41.175756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1404/2810] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:41 2022] PUT /identity/v3/projects/9af8aed48a8d4c0fbd3c357d471dbe5f/users/d59a218d652340eda8fcf124a8cae5c1/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:41.179768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:41.190254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1e40e-6486-4d31-8966-5c81d52fd5e1 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:41.242780 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534dfa5-2cf9-4862-9715-a1ceaea406dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:41.243427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534dfa5-2cf9-4862-9715-a1ceaea406dd admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:41.243710 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534dfa5-2cf9-4862-9715-a1ceaea406dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:41.243982 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534dfa5-2cf9-4862-9715-a1ceaea406dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:41.244694 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534dfa5-2cf9-4862-9715-a1ceaea406dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:41.246875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534dfa5-2cf9-4862-9715-a1ceaea406dd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:41.256142 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1407/2811] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:41.260190 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:41.270252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d4c5f-b798-402b-8fd8-9e879293e987 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:41.274870 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:41.275730 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:41.276035 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:41.276303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] PATH_INFO: `/v3/projects/9af8aed48a8d4c0fbd3c357d471dbe5f/users/d59a218d652340eda8fcf124a8cae5c1/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:41.278260 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af8aed48a8d4c0fbd3c357d471dbe5f, user_id=d59a218d652340eda8fcf124a8cae5c1, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:41.280975 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:41.291140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1405/2812] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:41 2022] PUT /identity/v3/projects/9af8aed48a8d4c0fbd3c357d471dbe5f/users/d59a218d652340eda8fcf124a8cae5c1/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:41.301277 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:41.301599 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:41.301871 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:41.327385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] MFA Rules not processed for user `d59a218d652340eda8fcf124a8cae5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:41.328572 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:41.394475 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1408/2813] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:41.405052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:41.407557 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:41.463143 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039000cc-795a-4694-b0c1-a7d3adb0fee0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:41.466872 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a0ae5-6903-4f2d-8dab-b5b7be6c4662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:41.467523 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0ae5-6903-4f2d-8dab-b5b7be6c4662 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:41.467807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0ae5-6903-4f2d-8dab-b5b7be6c4662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:41.468081 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a0ae5-6903-4f2d-8dab-b5b7be6c4662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:41.476880 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a0ae5-6903-4f2d-8dab-b5b7be6c4662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:41.478331 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a0ae5-6903-4f2d-8dab-b5b7be6c4662 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:41.487918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1406/2814] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:42.542773 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:42.602548 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c9b99-b8a9-4867-ac10-bef53d71d99c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:42.607104 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:42.607954 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:42.608240 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:42.608522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] PATH_INFO: `/v3/users/eef03a14617b4528a0ed9fd86b2d3074` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:42.609708 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef03a14617b4528a0ed9fd86b2d3074)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:42.611647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:42.769998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef03a14617b4528a0ed9fd86b2d3074'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:42.770587 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef03a14617b4528a0ed9fd86b2d3074'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:42.771185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef03a14617b4528a0ed9fd86b2d3074'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:42.831054 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef03a14617b4528a0ed9fd86b2d3074'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:42.838693 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef03a14617b4528a0ed9fd86b2d3074'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:42.856499 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1409/2815] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:42 2022] DELETE /identity/v3/users/eef03a14617b4528a0ed9fd86b2d3074 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:42.861219 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:42.861707 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:42.861817 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:42.879634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:42.880807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:42.935863 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1407/2816] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:42.945412 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:42.946839 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:43.001727 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3580539-c0d6-4605-ae52-296b1888fa97 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:43.005522 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:43.006204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:43.006490 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:43.006767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:43.015949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:43.017369 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:43.026544 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1410/2817] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:43.429086 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:43.438291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:43.445276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85f42a-00bc-4046-af9e-a97b7bb065ed None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:43.449873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:43.450755 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:43.451030 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:43.451873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] PATH_INFO: `/v3/projects/fb44a9c360ef46ab89ecc4fe873fd6a9` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:43.452501 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb44a9c360ef46ab89ecc4fe873fd6a9)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:43.454462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:43.568255 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb44a9c360ef46ab89ecc4fe873fd6a9', 'request_id': 'req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.573342 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb44a9c360ef46ab89ecc4fe873fd6a9', 'request_id': 'req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.579346 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb44a9c360ef46ab89ecc4fe873fd6a9', 'request_id': 'req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.655688 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] The token cache is being invalidate because project fb44a9c360ef46ab89ecc4fe873fd6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:43.655970 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.656608 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.658195 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1408/2818] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:43 2022] DELETE /identity/v3/projects/fb44a9c360ef46ab89ecc4fe873fd6a9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:43.662343 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:43.672963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5575c-c4bf-4d02-a609-2fae01806159 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:43.735956 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:43.736826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:43.737107 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:43.737383 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] PATH_INFO: `/v3/users/d59a218d652340eda8fcf124a8cae5c1` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:43.738632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59a218d652340eda8fcf124a8cae5c1)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:43.740561 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:43.954713 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59a218d652340eda8fcf124a8cae5c1'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.955362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59a218d652340eda8fcf124a8cae5c1'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:43.955973 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59a218d652340eda8fcf124a8cae5c1'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.021912 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59a218d652340eda8fcf124a8cae5c1'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.029402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-7018400c-d068-4b39-b1b3-382e5f15e7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59a218d652340eda8fcf124a8cae5c1'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.048359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1411/2819] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:43 2022] DELETE /identity/v3/users/d59a218d652340eda8fcf124a8cae5c1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:44.470071 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:44.471748 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:44.484509 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb7a8d-a342-4eb4-aa14-7ab6da61a7e6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:44.540334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:44.541186 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:44.541484 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:44.541756 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] PATH_INFO: `/v3/projects/9af8aed48a8d4c0fbd3c357d471dbe5f` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:44.542995 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af8aed48a8d4c0fbd3c357d471dbe5f)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:44.544878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:44.660356 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af8aed48a8d4c0fbd3c357d471dbe5f', 'request_id': 'req-192f5f4e-2690-4517-bf57-a59fb5c61eeb'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.665758 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af8aed48a8d4c0fbd3c357d471dbe5f', 'request_id': 'req-192f5f4e-2690-4517-bf57-a59fb5c61eeb'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.671621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af8aed48a8d4c0fbd3c357d471dbe5f', 'request_id': 'req-192f5f4e-2690-4517-bf57-a59fb5c61eeb'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.752733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] The token cache is being invalidate because project 9af8aed48a8d4c0fbd3c357d471dbe5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:44.752935 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.753536 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-192f5f4e-2690-4517-bf57-a59fb5c61eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:44.755091 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1409/2820] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:44 2022] DELETE /identity/v3/projects/9af8aed48a8d4c0fbd3c357d471dbe5f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:44.761031 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:44.764863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:44.764863 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:44.779622 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:44.780872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:44.837884 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1412/2821] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:44.845891 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:44.846212 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:44.846485 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:44.864062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:44.865277 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:44.873458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1410/2822] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:44.877556 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:44.887513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500854-6eb1-4489-874e-e82e29a96fac None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:44.892057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:44.892695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:44.892981 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:44.893260 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:44.893994 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:21:44.894323 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:44.895898 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:44.907074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1413/2823] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:21:44.911083 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:44.920616 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af561512-9d41-4e30-9c4d-b0db57eeb260 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:44.925140 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:44.925767 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:44.926074 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:44.926345 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:44.927018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:44.928909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.034713 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1411/2824] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:44 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:45.040141 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.050230 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f037d84-cbc4-4658-8cb4-e47edc2fa6b4 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:45.109183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:45.109851 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.110181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.110460 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.111151 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:45.113053 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.353579 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1414/2825] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:45 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:45.359710 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.368303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bc32a-d81b-4eeb-83e1-19b901632094 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:45.373336 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:45.374017 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.374306 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.374631 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.375350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:45.376943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.387774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1412/2826] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:45.391580 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.401318 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b1ff7-1279-4a9f-b8db-cee2a431e8c0 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:45.405820 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b443a-8124-446b-a0df-5a2d09106b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:45.406503 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b443a-8124-446b-a0df-5a2d09106b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.406804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b443a-8124-446b-a0df-5a2d09106b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.407060 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b443a-8124-446b-a0df-5a2d09106b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.407789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b443a-8124-446b-a0df-5a2d09106b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:45.409377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b443a-8124-446b-a0df-5a2d09106b60 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.420464 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1415/2827] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:45.425924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.436369 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fa129-f15f-41d1-8dc7-2e63372f85fe admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:45.441055 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:45.441954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.442265 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.442650 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] PATH_INFO: `/v3/projects/8e37b66dbf5a420488f15850d59aac3f/users/ed7bb42981f146d7991469cb2253f25f/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.457807 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e37b66dbf5a420488f15850d59aac3f, user_id=ed7bb42981f146d7991469cb2253f25f, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:45.460467 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.547109 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1413/2828] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:45 2022] PUT /identity/v3/projects/8e37b66dbf5a420488f15850d59aac3f/users/ed7bb42981f146d7991469cb2253f25f/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:45.557629 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.557951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.558264 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.588478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] MFA Rules not processed for user `ed7bb42981f146d7991469cb2253f25f`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:45.589872 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:45.650744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1416/2829] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:45.655117 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.714529 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a9a53-2c9b-48f4-bd57-dbf1bb3cc2de admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:45.719095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:45.719744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.720022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.720291 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.720974 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:45.722928 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.817013 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1414/2830] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:45 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:45.821033 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.831821 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740780d7-aeb8-4787-b9cf-5df3a5049347 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:45.887083 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:45.887744 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:45.888028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:45.888304 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:45.888993 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:45.890961 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:45.982098 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1417/2831] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:45 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:45.985903 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:45.996725 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8bc1d-95b9-4984-8fcb-608eda406057 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:46.001654 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:46.002350 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:46.002634 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:46.002909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:46.003699 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:46.005320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:46.015026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1415/2832] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:46.018963 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:46.028711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9254ca0-89ff-4b5d-b13f-e12c2aaa82bb admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:46.033338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:46.034428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:46.034931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:46.035427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] PATH_INFO: `/v3/projects/c8c6c7c7e9c1487aad480be7d33589d5/users/0fc012bdac784dd596d2a4ad80c35511/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:46.053476 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6c7c7e9c1487aad480be7d33589d5, user_id=0fc012bdac784dd596d2a4ad80c35511, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:46.056159 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:46.124435 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1418/2833] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:46 2022] PUT /identity/v3/projects/c8c6c7c7e9c1487aad480be7d33589d5/users/0fc012bdac784dd596d2a4ad80c35511/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:21:46.128413 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:46.138332 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440776-3a8b-4c6d-8cc4-69fdea98e049 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:46.192150 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2caad-9b6c-4d9f-ac92-ed3f52c7ae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:46.192799 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2caad-9b6c-4d9f-ac92-ed3f52c7ae41 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:46.193080 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2caad-9b6c-4d9f-ac92-ed3f52c7ae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:46.193357 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2caad-9b6c-4d9f-ac92-ed3f52c7ae41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:46.194095 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2caad-9b6c-4d9f-ac92-ed3f52c7ae41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:46.195676 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2caad-9b6c-4d9f-ac92-ed3f52c7ae41 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:46.204932 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1416/2834] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:46.209037 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:46.219842 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f38714-7794-4366-877a-162a974d37d3 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:46.224377 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:46.225234 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:46.225511 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:46.225781 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] PATH_INFO: `/v3/projects/c8c6c7c7e9c1487aad480be7d33589d5/users/0fc012bdac784dd596d2a4ad80c35511/roles/2cb59225af0e4b48b675859725e6b7d8` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:46.227737 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c6c7c7e9c1487aad480be7d33589d5, user_id=0fc012bdac784dd596d2a4ad80c35511, role_id=2cb59225af0e4b48b675859725e6b7d8)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:46.230915 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:46.240789 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1419/2835] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:46 2022] PUT /identity/v3/projects/c8c6c7c7e9c1487aad480be7d33589d5/users/0fc012bdac784dd596d2a4ad80c35511/roles/2cb59225af0e4b48b675859725e6b7d8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:46.250591 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:46.250876 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:46.251148 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:46.276284 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] MFA Rules not processed for user `0fc012bdac784dd596d2a4ad80c35511`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:46.277554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:46.340206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1417/2836] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:46.350688 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:46.352438 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:46.407931 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955fb7f-a4e6-4ba0-b5d7-87a75e9aba38 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:46.411721 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:46.412361 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:46.412647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:46.412924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:46.468941 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:46.470406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:46.479092 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1420/2837] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:51.444947 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:51.446343 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:51.458462 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1755c-88ba-4855-b929-7cfdda46c2a2 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:51.461943 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a40bc-2f3f-4a89-87a3-84a34349acc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:51.462595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a40bc-2f3f-4a89-87a3-84a34349acc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:51.462875 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a40bc-2f3f-4a89-87a3-84a34349acc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:51.463188 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a40bc-2f3f-4a89-87a3-84a34349acc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:51.471720 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a40bc-2f3f-4a89-87a3-84a34349acc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:51.473127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a40bc-2f3f-4a89-87a3-84a34349acc3 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:51.482177 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1418/2838] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:57.090406 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:57.149646 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c836cb5-ea05-4c9f-a4bc-ae15e15d43cc service cinder] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:57.154479 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:57.155326 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:57.155603 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:57.155873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] PATH_INFO: `/v3/users/ed7bb42981f146d7991469cb2253f25f` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:57.157032 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7bb42981f146d7991469cb2253f25f)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:57.158965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:57.334778 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7bb42981f146d7991469cb2253f25f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:57.335429 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7bb42981f146d7991469cb2253f25f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:57.336028 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7bb42981f146d7991469cb2253f25f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:57.392584 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7bb42981f146d7991469cb2253f25f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:57.399520 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7bb42981f146d7991469cb2253f25f'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:57.416242 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1421/2839] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:57 2022] DELETE /identity/v3/users/ed7bb42981f146d7991469cb2253f25f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:57.420818 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:57.421322 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:57.421443 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:57.438917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:57.440141 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:57.496750 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1419/2840] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:57.506115 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:57.507531 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:57.563103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82154e6b-bce3-49f2-b4f3-a927668c4942 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:57.566678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:57.567316 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:57.567598 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:57.567875 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:57.576554 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:57.577962 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:57.587121 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1422/2841] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:21:57.954990 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:57.956480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:57.970982 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c622ff-a813-482e-84c3-9714d3f9dcab None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:57.976061 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:57.977089 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:57.977418 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:57.977647 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] PATH_INFO: `/v3/projects/8e37b66dbf5a420488f15850d59aac3f` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:57.978858 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e37b66dbf5a420488f15850d59aac3f)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:57.980774 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:58.076527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e37b66dbf5a420488f15850d59aac3f', 'request_id': 'req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.082040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e37b66dbf5a420488f15850d59aac3f', 'request_id': 'req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.088026 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e37b66dbf5a420488f15850d59aac3f', 'request_id': 'req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.151613 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] The token cache is being invalidate because project 8e37b66dbf5a420488f15850d59aac3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:58.151838 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.152458 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.154043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1420/2842] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:57 2022] DELETE /identity/v3/projects/8e37b66dbf5a420488f15850d59aac3f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:58.157990 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:58.167803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ffc86-4907-4a3e-9059-accf72812cac service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:58.221826 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:58.222716 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:58.223025 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:58.223299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] PATH_INFO: `/v3/users/0fc012bdac784dd596d2a4ad80c35511` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:58.224467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc012bdac784dd596d2a4ad80c35511)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:58.226443 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:58.430050 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc012bdac784dd596d2a4ad80c35511'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.430619 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc012bdac784dd596d2a4ad80c35511'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.431218 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc012bdac784dd596d2a4ad80c35511'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.541998 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc012bdac784dd596d2a4ad80c35511'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.549590 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-4372bb46-d574-455c-8331-be627c5dc9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc012bdac784dd596d2a4ad80c35511'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:58.566928 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1423/2843] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:21:58 2022] DELETE /identity/v3/users/0fc012bdac784dd596d2a4ad80c35511 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:58.975323 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:58.976829 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:58.990499 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d074b-c1e9-46a1-a860-0ec4bfdbbc6d admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.045377 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.046329 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.046670 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.047001 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] PATH_INFO: `/v3/projects/c8c6c7c7e9c1487aad480be7d33589d5` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.048016 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c6c7c7e9c1487aad480be7d33589d5)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.049905 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.150276 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c6c7c7e9c1487aad480be7d33589d5', 'request_id': 'req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:59.155921 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c6c7c7e9c1487aad480be7d33589d5', 'request_id': 'req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:59.161783 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c6c7c7e9c1487aad480be7d33589d5', 'request_id': 'req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:59.258578 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] The token cache is being invalidate because project c8c6c7c7e9c1487aad480be7d33589d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:21:59.258796 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:59.259444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4c509ea1-2818-4e0e-bae9-8dfc783d8e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:21:59.261466 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1421/2844] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:21:58 2022] DELETE /identity/v3/projects/c8c6c7c7e9c1487aad480be7d33589d5 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:21:59.267478 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.267950 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.268051 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.286696 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:59.287907 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:59.344880 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1424/2845] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:59.354179 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.354470 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.354752 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.372881 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:59.374127 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:59.381900 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1422/2846] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:59.386538 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.396328 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d2005-cbe1-48dc-a62d-ab10cc844bfe None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.401509 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.402183 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.402466 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.402738 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.403463 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:21:59.403768 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.405357 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.417924 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1425/2847] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:21:59.422636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.431996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc61a9-e170-4174-a4be-0bcb237a0d55 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.444400 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.445066 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.445347 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.445619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.446364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.448919 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.546961 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1423/2848] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:21:59 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:59.551014 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.561462 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573378ea-698f-4de4-b238-e2f871153e07 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.614886 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.615546 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.615831 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.616113 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.616791 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.618733 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.684997 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1426/2849] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:21:59 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:21:59.689209 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.700768 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e74ab-1cd6-495c-9795-5e749798e0d2 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.705693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.706402 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.706682 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.706962 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.707677 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.709268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.719667 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1424/2850] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:59.724038 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.734096 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab987319-a63f-481a-89b2-627b9be84cb8 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.738858 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d1168-a841-45b4-985a-a405fc1a1a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.739507 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d1168-a841-45b4-985a-a405fc1a1a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.739796 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d1168-a841-45b4-985a-a405fc1a1a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.740076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d1168-a841-45b4-985a-a405fc1a1a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.740816 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d1168-a841-45b4-985a-a405fc1a1a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.742458 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d1168-a841-45b4-985a-a405fc1a1a1a admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.753181 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1427/2851] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:21:59.757263 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.767836 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e64355-63dc-4174-862e-650e2d250ae0 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:21:59.775320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:21:59.776843 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.777334 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.777765 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] PATH_INFO: `/v3/projects/3acd9d27313143e2ad7c451599e7cb62/users/ee4f605cb80b4f1ba44e383e9a63b044/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.793391 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acd9d27313143e2ad7c451599e7cb62, user_id=ee4f605cb80b4f1ba44e383e9a63b044, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:21:59.796052 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:21:59.849823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1425/2852] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:21:59 2022] PUT /identity/v3/projects/3acd9d27313143e2ad7c451599e7cb62/users/ee4f605cb80b4f1ba44e383e9a63b044/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:21:59.861002 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:21:59.861295 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:21:59.861575 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:21:59.888844 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] MFA Rules not processed for user `ee4f605cb80b4f1ba44e383e9a63b044`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:21:59.890140 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:21:59.952776 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1428/2853] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:21:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:21:59.964040 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:21:59.965664 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:00.020693 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcf941-db00-4a2c-aadd-38e6010f851e admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:00.024289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bc62d-0ca9-4051-ba7c-6490ce7a0ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:00.024924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bc62d-0ca9-4051-ba7c-6490ce7a0ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:00.025208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bc62d-0ca9-4051-ba7c-6490ce7a0ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:00.025482 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bc62d-0ca9-4051-ba7c-6490ce7a0ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:00.033549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bc62d-0ca9-4051-ba7c-6490ce7a0ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:00.035009 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bc62d-0ca9-4051-ba7c-6490ce7a0ef1 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:00.044297 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1426/2854] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:21:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:00.062344 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:00.129204 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c51d7-6c8c-4e07-8c62-b81f91f3a7b6 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:00.133764 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:00.134681 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:00.134971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:00.135243 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] PATH_INFO: `/v3/users/ee4f605cb80b4f1ba44e383e9a63b044` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:00.136433 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4f605cb80b4f1ba44e383e9a63b044)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:00.138375 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:00.301804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4f605cb80b4f1ba44e383e9a63b044'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:00.302472 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4f605cb80b4f1ba44e383e9a63b044'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:00.303084 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4f605cb80b4f1ba44e383e9a63b044'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:00.368273 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4f605cb80b4f1ba44e383e9a63b044'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:00.375312 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4f605cb80b4f1ba44e383e9a63b044'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:00.392245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1429/2855] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:22:00 2022] DELETE /identity/v3/users/ee4f605cb80b4f1ba44e383e9a63b044 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:00.396686 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:00.396971 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:00.397247 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:00.420549 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:00.421897 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:00.480517 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1427/2856] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:00.490594 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:00.493269 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:00.547843 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e30139-1d73-40b5-a90f-1c12e173804d admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:00.551482 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da20d1-6314-4408-9f7e-706334ec60d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:00.552124 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da20d1-6314-4408-9f7e-706334ec60d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:00.552427 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da20d1-6314-4408-9f7e-706334ec60d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:00.552685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da20d1-6314-4408-9f7e-706334ec60d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:00.561623 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da20d1-6314-4408-9f7e-706334ec60d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:00.563081 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da20d1-6314-4408-9f7e-706334ec60d7 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:00.572378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1430/2857] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:22:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:00.920554 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:00.922012 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:00.934584 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05395707-7dff-4190-bfd5-d42641ffa9a8 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:00.939327 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:00.940211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:00.940489 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:00.940762 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] PATH_INFO: `/v3/projects/3acd9d27313143e2ad7c451599e7cb62` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:00.942958 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acd9d27313143e2ad7c451599e7cb62)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:00.944873 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.060924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acd9d27313143e2ad7c451599e7cb62', 'request_id': 'req-d77d12d2-d369-4961-84e6-6bc7c644a587'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:01.066225 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acd9d27313143e2ad7c451599e7cb62', 'request_id': 'req-d77d12d2-d369-4961-84e6-6bc7c644a587'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:01.072206 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acd9d27313143e2ad7c451599e7cb62', 'request_id': 'req-d77d12d2-d369-4961-84e6-6bc7c644a587'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:01.146480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] The token cache is being invalidate because project 3acd9d27313143e2ad7c451599e7cb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:22:01.146760 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:01.147389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-d77d12d2-d369-4961-84e6-6bc7c644a587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:01.148920 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1428/2858] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:22:00 2022] DELETE /identity/v3/projects/3acd9d27313143e2ad7c451599e7cb62 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:01.154363 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.154663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.154970 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.173772 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:01.175057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:01.230262 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1431/2859] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:01.238102 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.238389 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.238665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.256909 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:01.258122 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:01.265820 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1429/2860] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:01.269870 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.279707 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5690b9-4d55-48aa-be7d-3c54a0f613c0 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.284179 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.284819 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.285101 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.285382 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.286160 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:22:01.286582 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.288166 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.300178 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1432/2861] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:22:01.304416 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.313530 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f61a37-6a30-4000-a424-5f29ecf9aebe None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.318364 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.319010 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.319294 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.319571 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.320252 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.322168 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.418132 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1430/2862] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:22:01.422467 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.432813 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b8fcd-2af4-4f8b-bcec-2c16030a444e admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.489728 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.490426 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.490711 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.490985 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.491671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.493605 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.564169 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1433/2863] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:22:01 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:22:01.568043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.578593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178021a-d985-4bc6-bcf3-4eddacc5c5b6 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.583181 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.583833 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.584116 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.584394 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.585108 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.586806 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.597246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1431/2864] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:22:01.601222 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.611103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8ab6-35bb-4921-85a3-03dbc05179dd admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.615751 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c52da-47e6-4f2a-83ec-3fe49c89c2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.616399 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c52da-47e6-4f2a-83ec-3fe49c89c2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.616669 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c52da-47e6-4f2a-83ec-3fe49c89c2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.616944 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c52da-47e6-4f2a-83ec-3fe49c89c2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.617670 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c52da-47e6-4f2a-83ec-3fe49c89c2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.619280 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c52da-47e6-4f2a-83ec-3fe49c89c2ae admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.628977 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1434/2865] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:22:01.632911 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.643144 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641d05c-1cd9-4431-a9e3-f418666bf886 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.647683 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.648568 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.648845 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.649118 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] PATH_INFO: `/v3/projects/f1cf065257ec4a94a6d9ef347afe83a0/users/0b3cc87767ce43b7b18e2f13cdf9cb64/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.663851 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cf065257ec4a94a6d9ef347afe83a0, user_id=0b3cc87767ce43b7b18e2f13cdf9cb64, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.666857 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.732960 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1432/2866] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:22:01 2022] PUT /identity/v3/projects/f1cf065257ec4a94a6d9ef347afe83a0/users/0b3cc87767ce43b7b18e2f13cdf9cb64/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 26 14:22:01.793066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.793359 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.793638 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.819671 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] MFA Rules not processed for user `0b3cc87767ce43b7b18e2f13cdf9cb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:01.820923 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:01.882231 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1435/2867] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:01.893628 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:01.895460 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:01.949954 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c756dad-2c36-41e5-b530-49c80c2bc164 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:01.953542 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe8ef5-e93f-41c7-8108-3e99e94f5095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:01.954211 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8ef5-e93f-41c7-8108-3e99e94f5095 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:01.954497 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8ef5-e93f-41c7-8108-3e99e94f5095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:01.954771 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8ef5-e93f-41c7-8108-3e99e94f5095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:01.962869 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe8ef5-e93f-41c7-8108-3e99e94f5095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:01.964289 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbe8ef5-e93f-41c7-8108-3e99e94f5095 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:01.972744 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1433/2868] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:22:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:11.648971 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:11.731607 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26aab-db64-4ffc-9464-bf0921c7d57c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:11.736200 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:11.737057 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:11.737342 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:11.737621 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] PATH_INFO: `/v3/users/0b3cc87767ce43b7b18e2f13cdf9cb64` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:11.738856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3cc87767ce43b7b18e2f13cdf9cb64)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:11.740767 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:11.954685 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3cc87767ce43b7b18e2f13cdf9cb64'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:11.955338 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3cc87767ce43b7b18e2f13cdf9cb64'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:11.955938 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3cc87767ce43b7b18e2f13cdf9cb64'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.030862 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3cc87767ce43b7b18e2f13cdf9cb64'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.037829 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3cc87767ce43b7b18e2f13cdf9cb64'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.054757 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1436/2869] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:22:11 2022] DELETE /identity/v3/users/0b3cc87767ce43b7b18e2f13cdf9cb64 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:12.059299 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:12.059786 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:12.059887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:12.105288 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:12.106503 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:12.161528 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1434/2870] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:22:12.171313 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:12.172705 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:12.242235 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c1ace-67b6-4340-b00d-52dfc582544c admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:12.245731 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f1151-0689-47c8-87ca-6f67e2423bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:12.246397 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1151-0689-47c8-87ca-6f67e2423bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:12.246678 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1151-0689-47c8-87ca-6f67e2423bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:12.246951 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f1151-0689-47c8-87ca-6f67e2423bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:12.255679 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1151-0689-47c8-87ca-6f67e2423bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:12.257089 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f1151-0689-47c8-87ca-6f67e2423bb2 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:12.266794 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1437/2871] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:12.695789 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:12.697898 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:12.710303 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a1689-6943-47f1-b212-48248dcd6c9b None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:12.715665 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:12.716612 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:12.716887 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:12.717154 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] PATH_INFO: `/v3/projects/f1cf065257ec4a94a6d9ef347afe83a0` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:12.718363 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cf065257ec4a94a6d9ef347afe83a0)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:12.721208 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:12.830133 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cf065257ec4a94a6d9ef347afe83a0', 'request_id': 'req-4a807901-3608-444d-89f9-26e2271606ba'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.835320 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cf065257ec4a94a6d9ef347afe83a0', 'request_id': 'req-4a807901-3608-444d-89f9-26e2271606ba'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.841800 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cf065257ec4a94a6d9ef347afe83a0', 'request_id': 'req-4a807901-3608-444d-89f9-26e2271606ba'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.917246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] The token cache is being invalidate because project f1cf065257ec4a94a6d9ef347afe83a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:22:12.917527 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.918161 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-4a807901-3608-444d-89f9-26e2271606ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:12.919666 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1435/2872] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:22:12 2022] DELETE /identity/v3/projects/f1cf065257ec4a94a6d9ef347afe83a0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:12.925617 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:12.926139 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:12.926250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:12.954076 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:12.955171 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:13.010123 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1438/2873] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:13.017732 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.018125 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.018492 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.036746 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:13.037924 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:13.045894 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1436/2874] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:13.049849 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.059676 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef72ad-a7d8-4371-b690-fae51474f576 None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.064120 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.064752 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.065035 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.065310 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] PATH_INFO: `/v3/domains` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.066061 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80041) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 26 14:22:13.066368 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.067934 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.079543 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1439/2875] 10.222.0.23 () {58 vars in 1152 bytes} [Tue Apr 26 14:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 26 14:22:13.083723 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.092687 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97bd10-f8ff-47ff-a61a-fb040a6364c6 None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.097386 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.098062 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.098348 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.098622 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.099302 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.101198 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.188358 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1437/2876] 10.222.0.23 () {60 vars in 1152 bytes} [Tue Apr 26 14:22:13 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:22:13.192356 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.202825 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e539fc8-fb8d-4358-a564-da4a87fb71df admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.256803 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.257386 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.257666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.257939 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.258683 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.261187 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.346185 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1440/2877] 10.222.0.23 () {60 vars in 1143 bytes} [Tue Apr 26 14:22:13 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 26 14:22:13.350205 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.360169 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2fcde-59e9-44c4-8f17-db6740e876b8 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.364673 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.365319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.365601 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.365874 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.366621 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.368233 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.378594 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1438/2878] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:22:13.382348 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.392856 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18bdf5-0612-4ae4-893c-c67ae9998e37 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.397402 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47761c-9f28-43b4-813c-025b6dc4b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.398075 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47761c-9f28-43b4-813c-025b6dc4b2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.398362 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47761c-9f28-43b4-813c-025b6dc4b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.398636 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47761c-9f28-43b4-813c-025b6dc4b2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.399415 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47761c-9f28-43b4-813c-025b6dc4b2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.401040 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47761c-9f28-43b4-813c-025b6dc4b2a7 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.410845 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1441/2879] 10.222.0.23 () {58 vars in 1121 bytes} [Tue Apr 26 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 26 14:22:13.415197 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.425561 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca6d6a-29be-43ca-b631-9b26d1e8d037 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.433573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.433573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.433573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.433573 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] PATH_INFO: `/v3/projects/5ca083e71294442a835556dd0f9899d2/users/e96ea392186e4b668e04ee25af93e6e5/roles/70a105678f91431a9d75cf7309d9a810` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.447636 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca083e71294442a835556dd0f9899d2, user_id=e96ea392186e4b668e04ee25af93e6e5, role_id=70a105678f91431a9d75cf7309d9a810)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.450426 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.513088 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1439/2880] 10.222.0.23 () {60 vars in 1482 bytes} [Tue Apr 26 14:22:13 2022] PUT /identity/v3/projects/5ca083e71294442a835556dd0f9899d2/users/e96ea392186e4b668e04ee25af93e6e5/roles/70a105678f91431a9d75cf7309d9a810 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:13.524388 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] REQUEST_METHOD: `POST` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.524684 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.524965 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.551439 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.auth.core [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] MFA Rules not processed for user `e96ea392186e4b668e04ee25af93e6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80041) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:13.552647 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:13.613905 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1442/2881] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 26 14:22:13.624987 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:13.626663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:13.680092 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae25e64-250e-449e-927a-50693e7137d1 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:13.684259 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6984ee7-0b04-4262-9337-ef10cb198300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57a82877b3b14091b942181b4887edff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:13.684890 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6984ee7-0b04-4262-9337-ef10cb198300 service cinder] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:13.685172 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6984ee7-0b04-4262-9337-ef10cb198300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:13.685444 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6984ee7-0b04-4262-9337-ef10cb198300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:13.693432 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6984ee7-0b04-4262-9337-ef10cb198300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:13.694888 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6984ee7-0b04-4262-9337-ef10cb198300 service cinder] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:13.703410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1440/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:25.133245 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:25.214223 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd89f44-2356-4abe-b7e8-9c26895e657c None None] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:25.218804 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:25.219600 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:25.219879 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:25.220150 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] PATH_INFO: `/v3/users/e96ea392186e4b668e04ee25af93e6e5` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:25.221317 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e96ea392186e4b668e04ee25af93e6e5)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:25.223254 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:25.434695 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e96ea392186e4b668e04ee25af93e6e5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:25.435355 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e96ea392186e4b668e04ee25af93e6e5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:25.435958 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e96ea392186e4b668e04ee25af93e6e5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:25.495560 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e96ea392186e4b668e04ee25af93e6e5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:25.503087 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e96ea392186e4b668e04ee25af93e6e5'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:25.519836 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1443/2883] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:22:25 2022] DELETE /identity/v3/users/e96ea392186e4b668e04ee25af93e6e5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:25.524410 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] REQUEST_METHOD: `POST` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:25.524939 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:25.525044 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:25.542243 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.auth.core [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] MFA Rules not processed for user `4889fd0e623346d287cebc77099e6590`. Rule list: `[]` (Enabled: `True`). {{(pid=80042) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 26 14:22:25.543457 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:25.598268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1441/2884] 10.222.0.23 () {58 vars in 957 bytes} [Tue Apr 26 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 26 14:22:25.608576 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:25.610029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:25.686385 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340b63f-f8d9-42be-aac9-38890087256f admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:25.690021 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:25.690662 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:25.690948 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:25.691227 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:25.700208 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:25.701663 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:25.711029 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1444/2885] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:26.091514 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:26.092917 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:26.106411 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2259b0-b336-41ff-aed5-1062d8b6cd6e None None] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:26.112261 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:26.112743 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:26.113018 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:26.113285 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] PATH_INFO: `/v3/projects/5ca083e71294442a835556dd0f9899d2` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:26.114480 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca083e71294442a835556dd0f9899d2)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:26.116425 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:26.226246 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca083e71294442a835556dd0f9899d2', 'request_id': 'req-94b82719-5edf-4f7b-a6ef-287d6edd53f7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:26.231481 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca083e71294442a835556dd0f9899d2', 'request_id': 'req-94b82719-5edf-4f7b-a6ef-287d6edd53f7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:26.237435 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca083e71294442a835556dd0f9899d2', 'request_id': 'req-94b82719-5edf-4f7b-a6ef-287d6edd53f7'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:26.324376 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] The token cache is being invalidate because project 5ca083e71294442a835556dd0f9899d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80042) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:22:26.324738 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:26.326412 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:26.328051 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1442/2886] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:22:26 2022] DELETE /identity/v3/projects/5ca083e71294442a835556dd0f9899d2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:33.314848 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:33.316299 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:33.327319 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc543f-6e0b-46a7-b0dd-993514e263ed service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:33.374874 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b30d840c80a46799c0ac7d70daf0e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:33.375513 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] REQUEST_METHOD: `GET` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:33.375795 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:33.376066 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:33.377949 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:33.437634 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:33.439170 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:33.449384 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1445/2887] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 26 14:22:40.451449 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:40.452918 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:40.467043 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b82719-5edf-4f7b-a6ef-287d6edd53f7 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:40.471733 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:40.472595 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:40.472878 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:40.473149 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] PATH_INFO: `/v3/users/9cd225533a1e48a3a8f03339af74b851` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:40.474372 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd225533a1e48a3a8f03339af74b851)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:40.476324 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:40.645248 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd225533a1e48a3a8f03339af74b851'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:40.656937 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd225533a1e48a3a8f03339af74b851'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:40.657619 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd225533a1e48a3a8f03339af74b851'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:40.664979 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd225533a1e48a3a8f03339af74b851'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:40.665632 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd225533a1e48a3a8f03339af74b851'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:40.717727 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1443/2888] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:22:40 2022] DELETE /identity/v3/users/9cd225533a1e48a3a8f03339af74b851 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:40.963805 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:40.973920 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ecd48-fb86-4130-ac31-470bdc8c1251 service neutron] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:41.029873 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:41.030852 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:41.031186 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:41.031461 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] PATH_INFO: `/v3/projects/488b7e9fc3ac419e8f3acaf1bbfd8838` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:41.032632 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488b7e9fc3ac419e8f3acaf1bbfd8838)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:41.034558 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:41.127378 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'request_id': 'req-603ef482-fa41-415a-ba21-40d21c72c131'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.186815 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'request_id': 'req-603ef482-fa41-415a-ba21-40d21c72c131'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.192730 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'request_id': 'req-603ef482-fa41-415a-ba21-40d21c72c131'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.204127 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] The token cache is being invalidate because project 488b7e9fc3ac419e8f3acaf1bbfd8838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:22:41.204471 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.205103 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.206725 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1446/2889] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:22:40 2022] DELETE /identity/v3/projects/488b7e9fc3ac419e8f3acaf1bbfd8838 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:41.210593 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:41.212587 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:41.226471 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5c4ad-e807-4a1e-884e-7f035051f408 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:41.279588 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:41.280451 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:41.280729 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:41.280996 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] PATH_INFO: `/v3/users/142ed9d411914c72930b49acdfaf68dd` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:41.282222 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142ed9d411914c72930b49acdfaf68dd)` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:41.284162 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:41.457113 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142ed9d411914c72930b49acdfaf68dd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.468823 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142ed9d411914c72930b49acdfaf68dd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.469505 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142ed9d411914c72930b49acdfaf68dd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.476082 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142ed9d411914c72930b49acdfaf68dd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.476718 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.notifications [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142ed9d411914c72930b49acdfaf68dd'} {{(pid=80042) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:41.545955 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1444/2890] 10.222.0.23 () {58 vars in 1223 bytes} [Tue Apr 26 14:22:41 2022] DELETE /identity/v3/users/142ed9d411914c72930b49acdfaf68dd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:22:41.811250 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Authenticating user token {{(pid=80041) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:22:41.812666 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.fernet_utils [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80041) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:22:41.827308 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ef482-fa41-415a-ba21-40d21c72c131 admin admin] Validating token access rules against request {{(pid=80041) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:22:41.884074 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4889fd0e623346d287cebc77099e6590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c5b2c20b09b4ef2a475aac6bfb52ad9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80041) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:22:41.884659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:22:41.884937 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:22:41.885209 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] PATH_INFO: `/v3/projects/5d96de440e26445094878f0f21a3670a` {{(pid=80041) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:22:41.886428 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d96de440e26445094878f0f21a3670a)` {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:22:41.888351 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] RBAC: Authorization granted {{(pid=80041) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:22:42.003297 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d96de440e26445094878f0f21a3670a', 'request_id': 'req-c8e15c89-5275-4816-9149-ba50a43909e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:42.092763 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d96de440e26445094878f0f21a3670a', 'request_id': 'req-c8e15c89-5275-4816-9149-ba50a43909e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:42.098157 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d96de440e26445094878f0f21a3670a', 'request_id': 'req-c8e15c89-5275-4816-9149-ba50a43909e3'} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:42.109372 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] The token cache is being invalidate because project 5d96de440e26445094878f0f21a3670a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80041) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 26 14:22:42.109659 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:42.110305 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: DEBUG keystone.notifications [None req-c8e15c89-5275-4816-9149-ba50a43909e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80041) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 26 14:22:42.111835 dv-cinder-835133-2-iscsi devstack@keystone.service[80041]: [pid: 80041|app: 0|req: 1447/2891] 10.222.0.23 () {58 vars in 1232 bytes} [Tue Apr 26 14:22:41 2022] DELETE /identity/v3/projects/5d96de440e26445094878f0f21a3670a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 26 14:23:22.650319 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Authenticating user token {{(pid=80042) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 26 14:23:22.651706 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:23:22.739552 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87acf1-233c-41a0-ac44-45047dd73261 admin admin] Validating token access rules against request {{(pid=80042) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 26 14:23:22.796022 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952f39b205c74255a2776e7fec3b8643', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e8965b215ec64df5bb4bc3c9d91922e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80042) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 26 14:23:22.796663 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] REQUEST_METHOD: `GET` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 26 14:23:22.796942 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] SCRIPT_NAME: `/identity` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 26 14:23:22.797217 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80042) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 26 14:23:22.798980 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.fernet_utils [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80042) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 26 14:23:22.810268 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 26 14:23:22.811828 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4ce4-7094-43dc-b7e2-861d8d0d3eab service placement] RBAC: Authorization granted {{(pid=80042) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 26 14:23:22.821984 dv-cinder-835133-2-iscsi devstack@keystone.service[80042]: [pid: 80042|app: 0|req: 1445/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Tue Apr 26 14:23:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)